2023-02-07 19:02:48,836 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-07 19:02:48,881 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=169, AvailableMemoryMB=6083 2023-02-07 19:02:49,137 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448 2023-02-07 19:02:49,144 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:02:49,145 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2, deleteOnExit=true 2023-02-07 19:02:49,145 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:02:49,146 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/test.cache.data in system properties and HBase conf 2023-02-07 19:02:49,146 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:02:49,147 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:02:49,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:02:49,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:02:49,148 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:02:49,278 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-07 19:02:49,639 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:02:49,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:02:49,643 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:02:49,644 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:02:49,644 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:02:49,644 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:02:49,645 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:02:49,645 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:02:49,646 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:02:49,646 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:02:49,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:02:49,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:02:49,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:02:49,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:02:49,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:02:50,097 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:02:50,101 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:02:50,358 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 19:02:50,509 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-07 19:02:50,524 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:02:50,559 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:02:50,590 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/java.io.tmpdir/Jetty_localhost_39993_hdfs____.xnadm1/webapp 2023-02-07 19:02:50,734 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39993 2023-02-07 19:02:50,746 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:02:50,746 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:02:51,286 WARN [Listener at localhost/46511] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:02:51,371 WARN [Listener at localhost/46511] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:02:51,395 WARN [Listener at localhost/46511] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:02:51,403 INFO [Listener at localhost/46511] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:02:51,409 INFO [Listener at localhost/46511] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/java.io.tmpdir/Jetty_localhost_43879_datanode____e1cy3m/webapp 2023-02-07 19:02:51,523 INFO [Listener at localhost/46511] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43879 2023-02-07 19:02:51,961 WARN [Listener at localhost/32957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:02:51,995 WARN [Listener at localhost/32957] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:02:52,006 WARN [Listener at localhost/32957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:02:52,009 INFO [Listener at localhost/32957] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:02:52,016 INFO [Listener at localhost/32957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/java.io.tmpdir/Jetty_localhost_44923_datanode____uexorl/webapp 2023-02-07 19:02:52,134 INFO [Listener at localhost/32957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44923 2023-02-07 19:02:52,145 WARN [Listener at localhost/39659] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:02:52,467 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d9c82d7247798c9: Processing first storage report for DS-55552969-3b6d-433b-bc26-c29a1b94755e from datanode 88b7d381-622d-4aac-8283-c12ac2223b09 2023-02-07 19:02:52,468 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d9c82d7247798c9: from storage DS-55552969-3b6d-433b-bc26-c29a1b94755e node DatanodeRegistration(127.0.0.1:40267, datanodeUuid=88b7d381-622d-4aac-8283-c12ac2223b09, infoPort=39231, infoSecurePort=0, ipcPort=32957, storageInfo=lv=-57;cid=testClusterID;nsid=2117635592;c=1675796570166), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 19:02:52,469 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f016dfa0f039532: Processing first storage report for DS-22ef5b15-890a-4d6b-b818-311e3f696ce5 from datanode 944cb445-6a49-46a1-95c9-f75fa691e9be 2023-02-07 19:02:52,469 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f016dfa0f039532: from storage DS-22ef5b15-890a-4d6b-b818-311e3f696ce5 node DatanodeRegistration(127.0.0.1:40869, datanodeUuid=944cb445-6a49-46a1-95c9-f75fa691e9be, infoPort=44091, infoSecurePort=0, ipcPort=39659, storageInfo=lv=-57;cid=testClusterID;nsid=2117635592;c=1675796570166), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:02:52,469 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d9c82d7247798c9: Processing first storage report for DS-1b0f75f3-4cb1-47e1-acb6-eca762a328c2 from datanode 88b7d381-622d-4aac-8283-c12ac2223b09 2023-02-07 19:02:52,469 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d9c82d7247798c9: from storage DS-1b0f75f3-4cb1-47e1-acb6-eca762a328c2 node DatanodeRegistration(127.0.0.1:40267, datanodeUuid=88b7d381-622d-4aac-8283-c12ac2223b09, infoPort=39231, infoSecurePort=0, ipcPort=32957, storageInfo=lv=-57;cid=testClusterID;nsid=2117635592;c=1675796570166), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:02:52,469 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f016dfa0f039532: Processing first storage report for DS-67cf5d51-9424-402f-a5fc-51e29ed0b0ca from datanode 944cb445-6a49-46a1-95c9-f75fa691e9be 2023-02-07 19:02:52,469 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f016dfa0f039532: from storage DS-67cf5d51-9424-402f-a5fc-51e29ed0b0ca node DatanodeRegistration(127.0.0.1:40869, datanodeUuid=944cb445-6a49-46a1-95c9-f75fa691e9be, infoPort=44091, infoSecurePort=0, ipcPort=39659, storageInfo=lv=-57;cid=testClusterID;nsid=2117635592;c=1675796570166), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:02:52,577 DEBUG [Listener at localhost/39659] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448 2023-02-07 19:02:52,725 INFO [Listener at localhost/39659] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/zookeeper_0, clientPort=51055, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:02:52,742 INFO [Listener at localhost/39659] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51055 2023-02-07 19:02:52,755 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:52,758 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:53,460 INFO [Listener at localhost/39659] util.FSUtils(479): Created version file at hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387 with version=8 2023-02-07 19:02:53,460 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:53,462 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:53,465 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/hbase-staging 2023-02-07 19:02:53,790 INFO [Listener at localhost/39659] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-07 19:02:54,255 INFO [Listener at localhost/39659] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:02:54,290 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,290 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,291 INFO [Listener at localhost/39659] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:02:54,291 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,291 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:02:54,434 INFO [Listener at localhost/39659] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:02:54,509 DEBUG [Listener at localhost/39659] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-07 19:02:54,600 INFO [Listener at localhost/39659] ipc.NettyRpcServer(120): Bind to /172.31.2.20:41363 2023-02-07 19:02:54,610 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:54,613 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:54,635 INFO [Listener at localhost/39659] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41363 connecting to ZooKeeper ensemble=127.0.0.1:51055 2023-02-07 19:02:54,685 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:413630x0, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:02:54,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41363-0x1013e979e660000 connected 2023-02-07 19:02:54,716 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:02:54,717 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:02:54,722 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:02:54,733 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41363 2023-02-07 19:02:54,734 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41363 2023-02-07 19:02:54,737 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41363 2023-02-07 19:02:54,738 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41363 2023-02-07 19:02:54,738 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41363 2023-02-07 19:02:54,744 INFO [Listener at localhost/39659] master.HMaster(439): hbase.rootdir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387, hbase.cluster.distributed=false 2023-02-07 19:02:54,812 INFO [Listener at localhost/39659] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:02:54,812 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,813 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,813 INFO [Listener at localhost/39659] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:02:54,813 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,813 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:02:54,818 INFO [Listener at localhost/39659] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:02:54,821 INFO [Listener at localhost/39659] ipc.NettyRpcServer(120): Bind to /172.31.2.20:37771 2023-02-07 19:02:54,823 INFO [Listener at localhost/39659] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:02:54,830 DEBUG [Listener at localhost/39659] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:02:54,831 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:54,833 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:54,835 INFO [Listener at localhost/39659] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37771 connecting to ZooKeeper ensemble=127.0.0.1:51055 2023-02-07 19:02:54,839 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:377710x0, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:02:54,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37771-0x1013e979e660001 connected 2023-02-07 19:02:54,840 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:02:54,841 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:02:54,842 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:02:54,844 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37771 2023-02-07 19:02:54,846 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37771 2023-02-07 19:02:54,847 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37771 2023-02-07 19:02:54,847 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37771 2023-02-07 19:02:54,848 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37771 2023-02-07 19:02:54,866 INFO [Listener at localhost/39659] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:02:54,867 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,867 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,868 INFO [Listener at localhost/39659] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:02:54,868 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:02:54,868 INFO [Listener at localhost/39659] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:02:54,868 INFO [Listener at localhost/39659] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:02:54,870 INFO [Listener at localhost/39659] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39131 2023-02-07 19:02:54,871 INFO [Listener at localhost/39659] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:02:54,872 DEBUG [Listener at localhost/39659] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:02:54,873 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:54,876 INFO [Listener at localhost/39659] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:54,879 INFO [Listener at localhost/39659] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39131 connecting to ZooKeeper ensemble=127.0.0.1:51055 2023-02-07 19:02:54,886 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:391310x0, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:02:54,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39131-0x1013e979e660002 connected 2023-02-07 19:02:54,887 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:02:54,888 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:02:54,889 DEBUG [Listener at localhost/39659] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:02:54,889 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39131 2023-02-07 19:02:54,890 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39131 2023-02-07 19:02:54,894 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39131 2023-02-07 19:02:54,895 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39131 2023-02-07 19:02:54,895 DEBUG [Listener at localhost/39659] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39131 2023-02-07 19:02:54,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:54,906 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:02:54,908 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:54,931 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:02:54,931 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:02:54,931 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:02:54,931 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:54,932 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:02:54,934 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,41363,1675796573627 from backup master directory 2023-02-07 19:02:54,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:02:54,937 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:54,937 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:02:54,938 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:02:54,938 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:54,941 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-07 19:02:54,943 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-07 19:02:55,026 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/hbase.id with ID: ac00a548-3907-4e3b-9be6-e8cd75cfa1a3 2023-02-07 19:02:55,067 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:02:55,084 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:55,129 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x46ecd70c to 127.0.0.1:51055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:02:55,162 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@597144f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:02:55,186 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:02:55,188 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:02:55,207 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-07 19:02:55,207 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-07 19:02:55,209 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 19:02:55,213 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 19:02:55,214 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:02:55,250 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store-tmp 2023-02-07 19:02:55,287 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:55,288 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:02:55,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:02:55,288 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:02:55,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:02:55,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:02:55,289 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:02:55,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796575288Disabling compacts and flushes for region at 1675796575288Disabling writes for close at 1675796575289 (+1 ms)Writing region close event to WAL at 1675796575289Closed at 1675796575289 2023-02-07 19:02:55,291 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/WALs/jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:55,317 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C41363%2C1675796573627, suffix=, logDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/WALs/jenkins-hbase6.apache.org,41363,1675796573627, archiveDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/oldWALs, maxLogs=10 2023-02-07 19:02:55,377 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK] 2023-02-07 19:02:55,377 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK] 2023-02-07 19:02:55,385 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-07 19:02:55,461 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/WALs/jenkins-hbase6.apache.org,41363,1675796573627/jenkins-hbase6.apache.org%2C41363%2C1675796573627.1675796575327 2023-02-07 19:02:55,461 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK], DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK]] 2023-02-07 19:02:55,462 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:02:55,462 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:55,466 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:02:55,468 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:02:55,532 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:02:55,539 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:02:55,567 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:02:55,578 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:55,584 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:02:55,585 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:02:55,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:02:55,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:55,605 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60457719, jitterRate=-0.09910978376865387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:02:55,605 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796575496Initializing all the Stores at 1675796575499 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796575499Cleaning up temporary data from old regions at 1675796575591 (+92 ms)Cleaning up detritus from prior splits at 1675796575592 (+1 ms)Region opened successfully at 1675796575605 (+13 ms) 2023-02-07 19:02:55,606 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:02:55,629 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:02:55,629 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:02:55,631 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:02:55,633 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-07 19:02:55,668 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-07 19:02:55,668 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:02:55,699 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:02:55,704 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:02:55,729 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:02:55,734 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:02:55,735 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:02:55,742 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:02:55,746 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:02:55,749 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:55,750 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:02:55,751 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:02:55,763 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:02:55,769 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:02:55,769 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:02:55,769 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:55,769 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:02:55,772 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,41363,1675796573627, sessionid=0x1013e979e660000, setting cluster-up flag (Was=false) 2023-02-07 19:02:55,793 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:55,800 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:02:55,802 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:55,808 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:55,815 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:02:55,817 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:55,820 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.hbase-snapshot/.tmp 2023-02-07 19:02:55,899 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(952): ClusterId : ac00a548-3907-4e3b-9be6-e8cd75cfa1a3 2023-02-07 19:02:55,899 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(952): ClusterId : ac00a548-3907-4e3b-9be6-e8cd75cfa1a3 2023-02-07 19:02:55,906 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:02:55,906 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:02:55,914 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:02:55,914 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:02:55,915 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:02:55,915 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:02:55,919 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:02:55,919 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:02:55,921 DEBUG [RS:1;jenkins-hbase6:39131] zookeeper.ReadOnlyZKClient(139): Connect 0x2ace2ed6 to 127.0.0.1:51055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:02:55,921 DEBUG [RS:0;jenkins-hbase6:37771] zookeeper.ReadOnlyZKClient(139): Connect 0x7a8a985e to 127.0.0.1:51055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:02:55,929 DEBUG [RS:1;jenkins-hbase6:39131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78355619, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:02:55,929 DEBUG [RS:0;jenkins-hbase6:37771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4aac2ac6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:02:55,930 DEBUG [RS:0;jenkins-hbase6:37771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eb4e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:02:55,930 DEBUG [RS:1;jenkins-hbase6:39131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5227781d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:02:55,956 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:39131 2023-02-07 19:02:55,956 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:37771 2023-02-07 19:02:55,961 INFO [RS:1;jenkins-hbase6:39131] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:02:55,961 INFO [RS:0;jenkins-hbase6:37771] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:02:55,961 INFO [RS:1;jenkins-hbase6:39131] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:02:55,961 INFO [RS:0;jenkins-hbase6:37771] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:02:55,961 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:02:55,962 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:02:55,964 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,41363,1675796573627 with isa=jenkins-hbase6.apache.org/172.31.2.20:39131, startcode=1675796574866 2023-02-07 19:02:55,964 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,41363,1675796573627 with isa=jenkins-hbase6.apache.org/172.31.2.20:37771, startcode=1675796574811 2023-02-07 19:02:55,976 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:02:55,983 DEBUG [RS:0;jenkins-hbase6:37771] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:02:55,983 DEBUG [RS:1;jenkins-hbase6:39131] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:02:55,991 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:02:55,991 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:02:55,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:02:55,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:02:55,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:02:55,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:55,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:02:55,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:55,994 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796605993 2023-02-07 19:02:55,997 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:02:56,025 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:02:56,026 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:02:56,035 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:02:56,044 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:02:56,062 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:02:56,065 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:02:56,065 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:02:56,064 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:02:56,087 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,118 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:02:56,121 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:02:56,121 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:02:56,124 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:02:56,125 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:02:56,126 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796576126,5,FailOnTimeoutGroup] 2023-02-07 19:02:56,127 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:54227, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:02:56,128 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796576127,5,FailOnTimeoutGroup] 2023-02-07 19:02:56,127 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48469, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:02:56,128 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,129 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:02:56,131 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,131 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,156 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:02:56,157 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:02:56,157 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387 2023-02-07 19:02:56,167 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387 2023-02-07 19:02:56,167 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387 2023-02-07 19:02:56,167 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46511 2023-02-07 19:02:56,167 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46511 2023-02-07 19:02:56,167 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:02:56,167 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:02:56,184 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:02:56,184 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:56,185 DEBUG [RS:0;jenkins-hbase6:37771] zookeeper.ZKUtil(162): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,185 DEBUG [RS:1;jenkins-hbase6:39131] zookeeper.ZKUtil(162): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,185 WARN [RS:0;jenkins-hbase6:37771] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:02:56,185 WARN [RS:1;jenkins-hbase6:39131] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:02:56,185 INFO [RS:0;jenkins-hbase6:37771] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:02:56,186 INFO [RS:1;jenkins-hbase6:39131] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:02:56,186 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,187 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,37771,1675796574811] 2023-02-07 19:02:56,188 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,188 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,39131,1675796574866] 2023-02-07 19:02:56,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:02:56,194 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/info 2023-02-07 19:02:56,195 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:02:56,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:56,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:02:56,198 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:02:56,199 DEBUG [RS:1;jenkins-hbase6:39131] zookeeper.ZKUtil(162): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,199 DEBUG [RS:0;jenkins-hbase6:37771] zookeeper.ZKUtil(162): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,199 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:02:56,199 DEBUG [RS:1;jenkins-hbase6:39131] zookeeper.ZKUtil(162): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,200 DEBUG [RS:0;jenkins-hbase6:37771] zookeeper.ZKUtil(162): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,201 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:56,201 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:02:56,203 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/table 2023-02-07 19:02:56,204 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:02:56,205 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:56,207 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740 2023-02-07 19:02:56,208 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740 2023-02-07 19:02:56,212 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:02:56,214 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:02:56,214 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:02:56,214 DEBUG [RS:1;jenkins-hbase6:39131] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:02:56,218 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:56,219 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62345968, jitterRate=-0.07097268104553223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:02:56,219 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796576184Initializing all the Stores at 1675796576187 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796576188 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796576188Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796576189 (+1 ms)Cleaning up temporary data from old regions at 1675796576210 (+21 ms)Cleaning up detritus from prior splits at 1675796576210Region opened successfully at 1675796576219 (+9 ms) 2023-02-07 19:02:56,219 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:02:56,219 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:02:56,220 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:02:56,220 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:02:56,220 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:02:56,221 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:02:56,221 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796576219Disabling compacts and flushes for region at 1675796576219Disabling writes for close at 1675796576220 (+1 ms)Writing region close event to WAL at 1675796576221 (+1 ms)Closed at 1675796576221 2023-02-07 19:02:56,226 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:02:56,226 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:02:56,227 INFO [RS:0;jenkins-hbase6:37771] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:02:56,227 INFO [RS:1;jenkins-hbase6:39131] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:02:56,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:02:56,249 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:02:56,252 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:02:56,252 INFO [RS:0;jenkins-hbase6:37771] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:02:56,252 INFO [RS:1;jenkins-hbase6:39131] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:02:56,257 INFO [RS:0;jenkins-hbase6:37771] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:02:56,257 INFO [RS:1;jenkins-hbase6:39131] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:02:56,257 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,257 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,259 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:02:56,259 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:02:56,267 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,267 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,267 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,267 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,268 DEBUG [RS:0;jenkins-hbase6:37771] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,269 DEBUG [RS:1;jenkins-hbase6:39131] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:02:56,270 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,270 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,270 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,270 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,270 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,270 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,286 INFO [RS:1;jenkins-hbase6:39131] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:02:56,286 INFO [RS:0;jenkins-hbase6:37771] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:02:56,289 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39131,1675796574866-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,289 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,37771,1675796574811-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,309 INFO [RS:1;jenkins-hbase6:39131] regionserver.Replication(203): jenkins-hbase6.apache.org,39131,1675796574866 started 2023-02-07 19:02:56,309 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,39131,1675796574866, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:39131, sessionid=0x1013e979e660002 2023-02-07 19:02:56,310 INFO [RS:0;jenkins-hbase6:37771] regionserver.Replication(203): jenkins-hbase6.apache.org,37771,1675796574811 started 2023-02-07 19:02:56,310 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:02:56,310 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,37771,1675796574811, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:37771, sessionid=0x1013e979e660001 2023-02-07 19:02:56,310 DEBUG [RS:1;jenkins-hbase6:39131] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,310 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:02:56,310 DEBUG [RS:1;jenkins-hbase6:39131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39131,1675796574866' 2023-02-07 19:02:56,310 DEBUG [RS:0;jenkins-hbase6:37771] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,311 DEBUG [RS:1;jenkins-hbase6:39131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:02:56,311 DEBUG [RS:0;jenkins-hbase6:37771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,37771,1675796574811' 2023-02-07 19:02:56,311 DEBUG [RS:0;jenkins-hbase6:37771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:02:56,312 DEBUG [RS:1;jenkins-hbase6:39131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:02:56,312 DEBUG [RS:0;jenkins-hbase6:37771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:02:56,313 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:02:56,313 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:02:56,313 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:02:56,313 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:02:56,313 DEBUG [RS:1;jenkins-hbase6:39131] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:56,313 DEBUG [RS:0;jenkins-hbase6:37771] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,313 DEBUG [RS:1;jenkins-hbase6:39131] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39131,1675796574866' 2023-02-07 19:02:56,313 DEBUG [RS:0;jenkins-hbase6:37771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,37771,1675796574811' 2023-02-07 19:02:56,314 DEBUG [RS:0;jenkins-hbase6:37771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:02:56,313 DEBUG [RS:1;jenkins-hbase6:39131] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:02:56,314 DEBUG [RS:0;jenkins-hbase6:37771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:02:56,314 DEBUG [RS:1;jenkins-hbase6:39131] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:02:56,315 DEBUG [RS:0;jenkins-hbase6:37771] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:02:56,315 DEBUG [RS:1;jenkins-hbase6:39131] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:02:56,315 INFO [RS:0;jenkins-hbase6:37771] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:02:56,315 INFO [RS:1;jenkins-hbase6:39131] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:02:56,315 INFO [RS:0;jenkins-hbase6:37771] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:02:56,316 INFO [RS:1;jenkins-hbase6:39131] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:02:56,404 DEBUG [jenkins-hbase6:41363] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:02:56,408 DEBUG [jenkins-hbase6:41363] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:02:56,414 DEBUG [jenkins-hbase6:41363] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:02:56,414 DEBUG [jenkins-hbase6:41363] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:02:56,415 DEBUG [jenkins-hbase6:41363] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:02:56,418 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,37771,1675796574811, state=OPENING 2023-02-07 19:02:56,425 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:02:56,426 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:56,427 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:02:56,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:56,618 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:56,622 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:02:56,625 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35898, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:02:56,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:02:56,639 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:02:56,642 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C37771%2C1675796574811.meta, suffix=.meta, logDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,37771,1675796574811, archiveDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/oldWALs, maxLogs=32 2023-02-07 19:02:56,662 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK] 2023-02-07 19:02:56,662 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK] 2023-02-07 19:02:56,667 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,37771,1675796574811/jenkins-hbase6.apache.org%2C37771%2C1675796574811.meta.1675796576646.meta 2023-02-07 19:02:56,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK], DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK]] 2023-02-07 19:02:56,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:02:56,671 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:02:56,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:02:56,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:02:56,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:02:56,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:56,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:02:56,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:02:56,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:02:56,704 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/info 2023-02-07 19:02:56,704 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/info 2023-02-07 19:02:56,705 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:02:56,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:56,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:02:56,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:02:56,709 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:02:56,710 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:02:56,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:56,711 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:02:56,713 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/table 2023-02-07 19:02:56,713 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/table 2023-02-07 19:02:56,713 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:02:56,714 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:56,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740 2023-02-07 19:02:56,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740 2023-02-07 19:02:56,724 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:02:56,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:02:56,728 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62788526, jitterRate=-0.0643780529499054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:02:56,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796576699Writing region info on filesystem at 1675796576699Initializing all the Stores at 1675796576701 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796576701Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796576701Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796576701Cleaning up temporary data from old regions at 1675796576721 (+20 ms)Cleaning up detritus from prior splits at 1675796576722 (+1 ms)Running coprocessor post-open hooks at 1675796576729 (+7 ms)Region opened successfully at 1675796576729 2023-02-07 19:02:56,742 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796576610 2023-02-07 19:02:56,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:02:56,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:02:56,766 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,37771,1675796574811, state=OPEN 2023-02-07 19:02:56,769 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:02:56,769 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:02:56,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:02:56,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,37771,1675796574811 in 338 msec 2023-02-07 19:02:56,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:02:56,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2023-02-07 19:02:56,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 896 msec 2023-02-07 19:02:56,784 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796574927, completionTime=-1 2023-02-07 19:02:56,785 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:02:56,785 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:02:56,859 DEBUG [hconnection-0x4204345c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:02:56,862 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35914, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:02:56,880 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:02:56,880 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796636880 2023-02-07 19:02:56,880 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796696880 2023-02-07 19:02:56,880 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 95 msec 2023-02-07 19:02:56,904 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,41363,1675796573627-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,905 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,41363,1675796573627-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,905 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,41363,1675796573627-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,907 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:41363, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,907 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:02:56,914 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:02:56,923 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:02:56,924 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:02:56,934 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:02:56,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:02:56,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:02:56,962 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:56,965 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c empty. 2023-02-07 19:02:56,966 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:56,966 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:02:56,994 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:02:56,997 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 12be8b6b9dc46ca60c25692a01e4fc7c, NAME => 'hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,016 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:57,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 12be8b6b9dc46ca60c25692a01e4fc7c, disabling compactions & flushes 2023-02-07 19:02:57,017 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. after waiting 0 ms 2023-02-07 19:02:57,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,017 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 12be8b6b9dc46ca60c25692a01e4fc7c: Waiting for close lock at 1675796577017Disabling compacts and flushes for region at 1675796577017Disabling writes for close at 1675796577017Writing region close event to WAL at 1675796577017Closed at 1675796577017 2023-02-07 19:02:57,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:02:57,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796577025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796577025"}]},"ts":"1675796577025"} 2023-02-07 19:02:57,068 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:02:57,070 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:02:57,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796577070"}]},"ts":"1675796577070"} 2023-02-07 19:02:57,079 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:02:57,083 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:02:57,086 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:02:57,086 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:02:57,086 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:02:57,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12be8b6b9dc46ca60c25692a01e4fc7c, ASSIGN}] 2023-02-07 19:02:57,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12be8b6b9dc46ca60c25692a01e4fc7c, ASSIGN 2023-02-07 19:02:57,094 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=12be8b6b9dc46ca60c25692a01e4fc7c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,37771,1675796574811; forceNewPlan=false, retain=false 2023-02-07 19:02:57,247 INFO [jenkins-hbase6:41363] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:02:57,248 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12be8b6b9dc46ca60c25692a01e4fc7c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:57,248 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796577247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796577247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796577247"}]},"ts":"1675796577247"} 2023-02-07 19:02:57,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 12be8b6b9dc46ca60c25692a01e4fc7c, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:57,327 INFO [RS:1;jenkins-hbase6:39131] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39131%2C1675796574866, suffix=, logDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,39131,1675796574866, archiveDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/oldWALs, maxLogs=32 2023-02-07 19:02:57,327 INFO [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C37771%2C1675796574811, suffix=, logDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,37771,1675796574811, archiveDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/oldWALs, maxLogs=32 2023-02-07 19:02:57,347 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK] 2023-02-07 19:02:57,348 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK] 2023-02-07 19:02:57,349 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK] 2023-02-07 19:02:57,349 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK] 2023-02-07 19:02:57,359 INFO [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,37771,1675796574811/jenkins-hbase6.apache.org%2C37771%2C1675796574811.1675796577329 2023-02-07 19:02:57,359 DEBUG [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK], DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK]] 2023-02-07 19:02:57,360 INFO [RS:1;jenkins-hbase6:39131] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,39131,1675796574866/jenkins-hbase6.apache.org%2C39131%2C1675796574866.1675796577329 2023-02-07 19:02:57,361 DEBUG [RS:1;jenkins-hbase6:39131] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-55552969-3b6d-433b-bc26-c29a1b94755e,DISK], DatanodeInfoWithStorage[127.0.0.1:40869,DS-22ef5b15-890a-4d6b-b818-311e3f696ce5,DISK]] 2023-02-07 19:02:57,413 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12be8b6b9dc46ca60c25692a01e4fc7c, NAME => 'hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:02:57,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:57,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,418 INFO [StoreOpener-12be8b6b9dc46ca60c25692a01e4fc7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,421 DEBUG [StoreOpener-12be8b6b9dc46ca60c25692a01e4fc7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/info 2023-02-07 19:02:57,421 DEBUG [StoreOpener-12be8b6b9dc46ca60c25692a01e4fc7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/info 2023-02-07 19:02:57,421 INFO [StoreOpener-12be8b6b9dc46ca60c25692a01e4fc7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12be8b6b9dc46ca60c25692a01e4fc7c columnFamilyName info 2023-02-07 19:02:57,422 INFO [StoreOpener-12be8b6b9dc46ca60c25692a01e4fc7c-1] regionserver.HStore(310): Store=12be8b6b9dc46ca60c25692a01e4fc7c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:57,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:02:57,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:57,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 12be8b6b9dc46ca60c25692a01e4fc7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73897136, jitterRate=0.10115313529968262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:02:57,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 12be8b6b9dc46ca60c25692a01e4fc7c: Running coprocessor pre-open hook at 1675796577414Writing region info on filesystem at 1675796577414Initializing all the Stores at 1675796577416 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796577416Cleaning up temporary data from old regions at 1675796577425 (+9 ms)Cleaning up detritus from prior splits at 1675796577426 (+1 ms)Running coprocessor post-open hooks at 1675796577434 (+8 ms)Region opened successfully at 1675796577434 2023-02-07 19:02:57,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c., pid=6, masterSystemTime=1675796577407 2023-02-07 19:02:57,441 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:02:57,443 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12be8b6b9dc46ca60c25692a01e4fc7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:57,443 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796577442"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796577442"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796577442"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796577442"}]},"ts":"1675796577442"} 2023-02-07 19:02:57,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:02:57,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 12be8b6b9dc46ca60c25692a01e4fc7c, server=jenkins-hbase6.apache.org,37771,1675796574811 in 195 msec 2023-02-07 19:02:57,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:02:57,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=12be8b6b9dc46ca60c25692a01e4fc7c, ASSIGN in 363 msec 2023-02-07 19:02:57,457 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:02:57,458 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796577457"}]},"ts":"1675796577457"} 2023-02-07 19:02:57,461 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:02:57,466 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:02:57,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 541 msec 2023-02-07 19:02:57,537 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:02:57,539 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:02:57,539 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:02:57,582 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:02:57,605 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:02:57,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-02-07 19:02:57,616 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:02:57,630 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:02:57,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-07 19:02:57,643 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:02:57,647 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:02:57,649 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.711sec 2023-02-07 19:02:57,651 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:02:57,653 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:02:57,653 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:02:57,654 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,41363,1675796573627-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:02:57,656 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,41363,1675796573627-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:02:57,665 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:02:57,728 DEBUG [Listener at localhost/39659] zookeeper.ReadOnlyZKClient(139): Connect 0x24925f51 to 127.0.0.1:51055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:02:57,733 DEBUG [Listener at localhost/39659] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@487731f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:02:57,760 DEBUG [hconnection-0x4a477aff-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:02:57,771 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35924, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:02:57,782 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:02:57,782 DEBUG [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:02:57,784 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:57,784 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:57,791 DEBUG [Listener at localhost/39659] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:02:57,794 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:02:57,799 INFO [Listener at localhost/39659] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 19:02:57,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-07 19:02:57,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:02:57,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.2.20:47570 deadline: 1675796637802, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 19:02:57,821 INFO [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 19:02:57,822 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:57,823 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:57,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:02:57,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 19:02:57,839 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:02:57,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:02:57,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 19:02:57,853 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:57,853 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:57,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:02:57,865 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:57,865 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:57,865 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:57,865 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:57,866 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:57,866 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:57,866 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:57,867 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc empty. 2023-02-07 19:02:57,866 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 empty. 2023-02-07 19:02:57,866 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:57,867 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 empty. 2023-02-07 19:02:57,868 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd empty. 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:57,867 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 empty. 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 empty. 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff empty. 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f empty. 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:57,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:57,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:57,870 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:57,870 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 empty. 2023-02-07 19:02:57,870 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:57,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:57,871 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce empty. 2023-02-07 19:02:57,871 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:57,871 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:57,872 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:57,873 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:57,873 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 19:02:57,893 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 19:02:57,895 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 46d15b5564040f0b4eea5b4129443c80, NAME => 'testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,897 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3f5c43a26bd48348e32e6c0a6784f9bc, NAME => 'testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,897 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => bf4ed18d3fe4cb6be11a1bb525169fa1, NAME => 'testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:57,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 46d15b5564040f0b4eea5b4129443c80, disabling compactions & flushes 2023-02-07 19:02:57,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:57,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:57,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. after waiting 0 ms 2023-02-07 19:02:57,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:57,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:57,939 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 46d15b5564040f0b4eea5b4129443c80: Waiting for close lock at 1675796577938Disabling compacts and flushes for region at 1675796577938Disabling writes for close at 1675796577938Writing region close event to WAL at 1675796577938Closed at 1675796577938 2023-02-07 19:02:57,940 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 99fa7a707c08f867ed590c773e5e4af7, NAME => 'testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,943 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:57,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3f5c43a26bd48348e32e6c0a6784f9bc, disabling compactions & flushes 2023-02-07 19:02:57,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:57,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:57,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. after waiting 0 ms 2023-02-07 19:02:57,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:57,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:57,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3f5c43a26bd48348e32e6c0a6784f9bc: Waiting for close lock at 1675796577944Disabling compacts and flushes for region at 1675796577944Disabling writes for close at 1675796577944Writing region close event to WAL at 1675796577944Closed at 1675796577944 2023-02-07 19:02:57,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f338c6378a72d9f763afd7ba0b32438f, NAME => 'testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:57,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing bf4ed18d3fe4cb6be11a1bb525169fa1, disabling compactions & flushes 2023-02-07 19:02:57,946 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:57,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:57,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. after waiting 0 ms 2023-02-07 19:02:57,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:57,946 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:57,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for bf4ed18d3fe4cb6be11a1bb525169fa1: Waiting for close lock at 1675796577946Disabling compacts and flushes for region at 1675796577946Disabling writes for close at 1675796577946Writing region close event to WAL at 1675796577946Closed at 1675796577946 2023-02-07 19:02:57,948 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2359dcea29fa95d230fbc0e4ee1168b7, NAME => 'testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:57,995 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:57,997 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:58,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:02:58,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 99fa7a707c08f867ed590c773e5e4af7, disabling compactions & flushes 2023-02-07 19:02:58,018 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. after waiting 0 ms 2023-02-07 19:02:58,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,018 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 99fa7a707c08f867ed590c773e5e4af7: Waiting for close lock at 1675796578018Disabling compacts and flushes for region at 1675796578018Disabling writes for close at 1675796578018Writing region close event to WAL at 1675796578018Closed at 1675796578018 2023-02-07 19:02:58,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9373da399ebea705ef68b02e1da07aff, NAME => 'testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:58,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f338c6378a72d9f763afd7ba0b32438f, disabling compactions & flushes 2023-02-07 19:02:58,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. after waiting 0 ms 2023-02-07 19:02:58,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f338c6378a72d9f763afd7ba0b32438f: Waiting for close lock at 1675796578021Disabling compacts and flushes for region at 1675796578021Disabling writes for close at 1675796578021Writing region close event to WAL at 1675796578021Closed at 1675796578021 2023-02-07 19:02:58,026 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 61486df234f2a47482b972d415e6e0bd, NAME => 'testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:58,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2359dcea29fa95d230fbc0e4ee1168b7, disabling compactions & flushes 2023-02-07 19:02:58,027 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. after waiting 0 ms 2023-02-07 19:02:58,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,028 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,028 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2359dcea29fa95d230fbc0e4ee1168b7: Waiting for close lock at 1675796578027Disabling compacts and flushes for region at 1675796578027Disabling writes for close at 1675796578027Writing region close event to WAL at 1675796578028 (+1 ms)Closed at 1675796578028 2023-02-07 19:02:58,028 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6986e39a4f96e5d8aa8f6416d3d9a2c6, NAME => 'testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:58,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 61486df234f2a47482b972d415e6e0bd, disabling compactions & flushes 2023-02-07 19:02:58,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. after waiting 0 ms 2023-02-07 19:02:58,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,062 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,062 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 61486df234f2a47482b972d415e6e0bd: Waiting for close lock at 1675796578061Disabling compacts and flushes for region at 1675796578061Disabling writes for close at 1675796578062 (+1 ms)Writing region close event to WAL at 1675796578062Closed at 1675796578062 2023-02-07 19:02:58,063 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9373da399ebea705ef68b02e1da07aff, disabling compactions & flushes 2023-02-07 19:02:58,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a077eee5fcca3c0df2ac9b6ea1b7e5ce, NAME => 'testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp 2023-02-07 19:02:58,064 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. after waiting 0 ms 2023-02-07 19:02:58,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,064 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,064 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9373da399ebea705ef68b02e1da07aff: Waiting for close lock at 1675796578063Disabling compacts and flushes for region at 1675796578063Disabling writes for close at 1675796578064 (+1 ms)Writing region close event to WAL at 1675796578064Closed at 1675796578064 2023-02-07 19:02:58,065 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,066 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6986e39a4f96e5d8aa8f6416d3d9a2c6, disabling compactions & flushes 2023-02-07 19:02:58,066 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,066 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,066 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. after waiting 0 ms 2023-02-07 19:02:58,066 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,066 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,066 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: Waiting for close lock at 1675796578066Disabling compacts and flushes for region at 1675796578066Disabling writes for close at 1675796578066Writing region close event to WAL at 1675796578066Closed at 1675796578066 2023-02-07 19:02:58,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a077eee5fcca3c0df2ac9b6ea1b7e5ce, disabling compactions & flushes 2023-02-07 19:02:58,079 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. after waiting 0 ms 2023-02-07 19:02:58,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,079 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: Waiting for close lock at 1675796578079Disabling compacts and flushes for region at 1675796578079Disabling writes for close at 1675796578079Writing region close event to WAL at 1675796578079Closed at 1675796578079 2023-02-07 19:02:58,085 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:02:58,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796578086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796578086"}]},"ts":"1675796578086"} 2023-02-07 19:02:58,139 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 19:02:58,141 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:02:58,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796578142"}]},"ts":"1675796578142"} 2023-02-07 19:02:58,144 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 19:02:58,150 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:02:58,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:02:58,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:02:58,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:02:58,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, ASSIGN}] 2023-02-07 19:02:58,169 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, ASSIGN 2023-02-07 19:02:58,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, ASSIGN 2023-02-07 19:02:58,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, ASSIGN 2023-02-07 19:02:58,170 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, ASSIGN 2023-02-07 19:02:58,171 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,37771,1675796574811; forceNewPlan=false, retain=false 2023-02-07 19:02:58,171 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39131,1675796574866; forceNewPlan=false, retain=false 2023-02-07 19:02:58,171 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,37771,1675796574811; forceNewPlan=false, retain=false 2023-02-07 19:02:58,171 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39131,1675796574866; forceNewPlan=false, retain=false 2023-02-07 19:02:58,172 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, ASSIGN 2023-02-07 19:02:58,172 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, ASSIGN 2023-02-07 19:02:58,173 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, ASSIGN 2023-02-07 19:02:58,173 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, ASSIGN 2023-02-07 19:02:58,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, ASSIGN 2023-02-07 19:02:58,174 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,37771,1675796574811; forceNewPlan=false, retain=false 2023-02-07 19:02:58,174 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39131,1675796574866; forceNewPlan=false, retain=false 2023-02-07 19:02:58,174 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39131,1675796574866; forceNewPlan=false, retain=false 2023-02-07 19:02:58,175 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,37771,1675796574811; forceNewPlan=false, retain=false 2023-02-07 19:02:58,175 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, ASSIGN 2023-02-07 19:02:58,175 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,37771,1675796574811; forceNewPlan=false, retain=false 2023-02-07 19:02:58,176 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39131,1675796574866; forceNewPlan=false, retain=false 2023-02-07 19:02:58,207 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:58,207 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:58,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:02:58,322 INFO [jenkins-hbase6:41363] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 19:02:58,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bf4ed18d3fe4cb6be11a1bb525169fa1, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=46d15b5564040f0b4eea5b4129443c80, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=61486df234f2a47482b972d415e6e0bd, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578325"}]},"ts":"1675796578325"} 2023-02-07 19:02:58,325 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6986e39a4f96e5d8aa8f6416d3d9a2c6, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796578325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578325"}]},"ts":"1675796578325"} 2023-02-07 19:02:58,325 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f338c6378a72d9f763afd7ba0b32438f, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,325 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578325"}]},"ts":"1675796578325"} 2023-02-07 19:02:58,326 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578325"}]},"ts":"1675796578325"} 2023-02-07 19:02:58,325 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578325"}]},"ts":"1675796578325"} 2023-02-07 19:02:58,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure bf4ed18d3fe4cb6be11a1bb525169fa1, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:02:58,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 46d15b5564040f0b4eea5b4129443c80, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:02:58,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure 6986e39a4f96e5d8aa8f6416d3d9a2c6, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:02:58,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure f338c6378a72d9f763afd7ba0b32438f, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:02:58,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 61486df234f2a47482b972d415e6e0bd, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:02:58,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9373da399ebea705ef68b02e1da07aff, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578336"}]},"ts":"1675796578336"} 2023-02-07 19:02:58,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 9373da399ebea705ef68b02e1da07aff, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:58,339 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a077eee5fcca3c0df2ac9b6ea1b7e5ce, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,339 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3f5c43a26bd48348e32e6c0a6784f9bc, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,339 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796578339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578339"}]},"ts":"1675796578339"} 2023-02-07 19:02:58,339 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578339"}]},"ts":"1675796578339"} 2023-02-07 19:02:58,341 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2359dcea29fa95d230fbc0e4ee1168b7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,341 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578340"}]},"ts":"1675796578340"} 2023-02-07 19:02:58,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=99fa7a707c08f867ed590c773e5e4af7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,342 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796578341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796578341"}]},"ts":"1675796578341"} 2023-02-07 19:02:58,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure a077eee5fcca3c0df2ac9b6ea1b7e5ce, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:58,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 3f5c43a26bd48348e32e6c0a6784f9bc, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:58,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure 2359dcea29fa95d230fbc0e4ee1168b7, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:58,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 99fa7a707c08f867ed590c773e5e4af7, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:02:58,482 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,482 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:02:58,486 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:02:58,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:58,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf4ed18d3fe4cb6be11a1bb525169fa1, NAME => 'testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 19:02:58,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,507 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 99fa7a707c08f867ed590c773e5e4af7, NAME => 'testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 19:02:58,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,509 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:58,509 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:58,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:02:58,514 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1 2023-02-07 19:02:58,514 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1 2023-02-07 19:02:58,515 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,515 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf4ed18d3fe4cb6be11a1bb525169fa1 columnFamilyName f1 2023-02-07 19:02:58,516 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(310): Store=bf4ed18d3fe4cb6be11a1bb525169fa1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,516 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,518 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1 2023-02-07 19:02:58,518 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1 2023-02-07 19:02:58,519 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2 2023-02-07 19:02:58,519 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99fa7a707c08f867ed590c773e5e4af7 columnFamilyName f1 2023-02-07 19:02:58,519 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2 2023-02-07 19:02:58,520 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf4ed18d3fe4cb6be11a1bb525169fa1 columnFamilyName f2 2023-02-07 19:02:58,520 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(310): Store=99fa7a707c08f867ed590c773e5e4af7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,521 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,521 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(310): Store=bf4ed18d3fe4cb6be11a1bb525169fa1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,525 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2 2023-02-07 19:02:58,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,525 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2 2023-02-07 19:02:58,526 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99fa7a707c08f867ed590c773e5e4af7 columnFamilyName f2 2023-02-07 19:02:58,527 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(310): Store=99fa7a707c08f867ed590c773e5e4af7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:02:58,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:02:58,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened bf4ed18d3fe4cb6be11a1bb525169fa1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69448638, jitterRate=0.034865349531173706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for bf4ed18d3fe4cb6be11a1bb525169fa1: Running coprocessor pre-open hook at 1675796578501Writing region info on filesystem at 1675796578501Initializing all the Stores at 1675796578502 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578502Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578507 (+5 ms)Cleaning up temporary data from old regions at 1675796578526 (+19 ms)Cleaning up detritus from prior splits at 1675796578527 (+1 ms)Running coprocessor post-open hooks at 1675796578536 (+9 ms)Region opened successfully at 1675796578536 2023-02-07 19:02:58,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1., pid=21, masterSystemTime=1675796578482 2023-02-07 19:02:58,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 99fa7a707c08f867ed590c773e5e4af7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65454137, jitterRate=-0.02465735375881195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 99fa7a707c08f867ed590c773e5e4af7: Running coprocessor pre-open hook at 1675796578508Writing region info on filesystem at 1675796578508Initializing all the Stores at 1675796578514 (+6 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578514Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578514Cleaning up temporary data from old regions at 1675796578530 (+16 ms)Cleaning up detritus from prior splits at 1675796578531 (+1 ms)Running coprocessor post-open hooks at 1675796578541 (+10 ms)Region opened successfully at 1675796578541 2023-02-07 19:02:58,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7., pid=30, masterSystemTime=1675796578491 2023-02-07 19:02:58,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:58,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:58,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:58,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 46d15b5564040f0b4eea5b4129443c80, NAME => 'testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 19:02:58,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bf4ed18d3fe4cb6be11a1bb525169fa1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578544"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578544"}]},"ts":"1675796578544"} 2023-02-07 19:02:58,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,551 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:02:58,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:58,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f5c43a26bd48348e32e6c0a6784f9bc, NAME => 'testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 19:02:58,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,554 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=99fa7a707c08f867ed590c773e5e4af7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578554"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578554"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578554"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578554"}]},"ts":"1675796578554"} 2023-02-07 19:02:58,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-07 19:02:58,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure bf4ed18d3fe4cb6be11a1bb525169fa1, server=jenkins-hbase6.apache.org,39131,1675796574866 in 225 msec 2023-02-07 19:02:58,557 DEBUG [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f1 2023-02-07 19:02:58,559 DEBUG [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f1 2023-02-07 19:02:58,559 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46d15b5564040f0b4eea5b4129443c80 columnFamilyName f1 2023-02-07 19:02:58,561 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, ASSIGN in 395 msec 2023-02-07 19:02:58,567 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(310): Store=46d15b5564040f0b4eea5b4129443c80/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,567 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,570 DEBUG [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f2 2023-02-07 19:02:58,570 DEBUG [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f2 2023-02-07 19:02:58,570 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46d15b5564040f0b4eea5b4129443c80 columnFamilyName f2 2023-02-07 19:02:58,571 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(310): Store=46d15b5564040f0b4eea5b4129443c80/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-07 19:02:58,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 99fa7a707c08f867ed590c773e5e4af7, server=jenkins-hbase6.apache.org,37771,1675796574811 in 214 msec 2023-02-07 19:02:58,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,576 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1 2023-02-07 19:02:58,576 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1 2023-02-07 19:02:58,577 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f5c43a26bd48348e32e6c0a6784f9bc columnFamilyName f1 2023-02-07 19:02:58,578 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(310): Store=3f5c43a26bd48348e32e6c0a6784f9bc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,578 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, ASSIGN in 412 msec 2023-02-07 19:02:58,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,581 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2 2023-02-07 19:02:58,581 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2 2023-02-07 19:02:58,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:02:58,583 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f5c43a26bd48348e32e6c0a6784f9bc columnFamilyName f2 2023-02-07 19:02:58,587 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(310): Store=3f5c43a26bd48348e32e6c0a6784f9bc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 46d15b5564040f0b4eea5b4129443c80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62565382, jitterRate=-0.06770315766334534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 46d15b5564040f0b4eea5b4129443c80: Running coprocessor pre-open hook at 1675796578545Writing region info on filesystem at 1675796578545Initializing all the Stores at 1675796578551 (+6 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578551Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578551Cleaning up temporary data from old regions at 1675796578577 (+26 ms)Cleaning up detritus from prior splits at 1675796578578 (+1 ms)Running coprocessor post-open hooks at 1675796578591 (+13 ms)Region opened successfully at 1675796578591 2023-02-07 19:02:58,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80., pid=22, masterSystemTime=1675796578482 2023-02-07 19:02:58,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:58,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:58,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=46d15b5564040f0b4eea5b4129443c80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 61486df234f2a47482b972d415e6e0bd, NAME => 'testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 19:02:58,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:02:58,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796578598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578598"}]},"ts":"1675796578598"} 2023-02-07 19:02:58,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,602 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 3f5c43a26bd48348e32e6c0a6784f9bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66224622, jitterRate=-0.01317623257637024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 3f5c43a26bd48348e32e6c0a6784f9bc: Running coprocessor pre-open hook at 1675796578557Writing region info on filesystem at 1675796578557Initializing all the Stores at 1675796578560 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578560Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578560Cleaning up temporary data from old regions at 1675796578592 (+32 ms)Cleaning up detritus from prior splits at 1675796578594 (+2 ms)Running coprocessor post-open hooks at 1675796578603 (+9 ms)Region opened successfully at 1675796578603 2023-02-07 19:02:58,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc., pid=28, masterSystemTime=1675796578491 2023-02-07 19:02:58,605 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1 2023-02-07 19:02:58,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-07 19:02:58,605 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1 2023-02-07 19:02:58,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 46d15b5564040f0b4eea5b4129443c80, server=jenkins-hbase6.apache.org,39131,1675796574866 in 271 msec 2023-02-07 19:02:58,606 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61486df234f2a47482b972d415e6e0bd columnFamilyName f1 2023-02-07 19:02:58,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:58,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:58,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9373da399ebea705ef68b02e1da07aff, NAME => 'testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 19:02:58,607 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(310): Store=61486df234f2a47482b972d415e6e0bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,607 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, ASSIGN in 442 msec 2023-02-07 19:02:58,608 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3f5c43a26bd48348e32e6c0a6784f9bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,608 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578608"}]},"ts":"1675796578608"} 2023-02-07 19:02:58,610 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,610 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2 2023-02-07 19:02:58,610 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2 2023-02-07 19:02:58,611 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61486df234f2a47482b972d415e6e0bd columnFamilyName f2 2023-02-07 19:02:58,612 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(310): Store=61486df234f2a47482b972d415e6e0bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,612 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1 2023-02-07 19:02:58,612 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1 2023-02-07 19:02:58,613 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9373da399ebea705ef68b02e1da07aff columnFamilyName f1 2023-02-07 19:02:58,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,614 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(310): Store=9373da399ebea705ef68b02e1da07aff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,614 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-07 19:02:58,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 3f5c43a26bd48348e32e6c0a6784f9bc, server=jenkins-hbase6.apache.org,37771,1675796574811 in 269 msec 2023-02-07 19:02:58,616 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2 2023-02-07 19:02:58,616 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2 2023-02-07 19:02:58,617 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9373da399ebea705ef68b02e1da07aff columnFamilyName f2 2023-02-07 19:02:58,617 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(310): Store=9373da399ebea705ef68b02e1da07aff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, ASSIGN in 453 msec 2023-02-07 19:02:58,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:02:58,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 61486df234f2a47482b972d415e6e0bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74006682, jitterRate=0.10278549790382385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 61486df234f2a47482b972d415e6e0bd: Running coprocessor pre-open hook at 1675796578599Writing region info on filesystem at 1675796578599Initializing all the Stores at 1675796578600 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578601 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578601Cleaning up temporary data from old regions at 1675796578615 (+14 ms)Cleaning up detritus from prior splits at 1675796578616 (+1 ms)Running coprocessor post-open hooks at 1675796578624 (+8 ms)Region opened successfully at 1675796578624 2023-02-07 19:02:58,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:02:58,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd., pid=25, masterSystemTime=1675796578482 2023-02-07 19:02:58,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:02:58,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6986e39a4f96e5d8aa8f6416d3d9a2c6, NAME => 'testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 19:02:58,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=61486df234f2a47482b972d415e6e0bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578629"}]},"ts":"1675796578629"} 2023-02-07 19:02:58,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 9373da399ebea705ef68b02e1da07aff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63519609, jitterRate=-0.05348406732082367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 9373da399ebea705ef68b02e1da07aff: Running coprocessor pre-open hook at 1675796578608Writing region info on filesystem at 1675796578608Initializing all the Stores at 1675796578609 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578609Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578609Cleaning up temporary data from old regions at 1675796578622 (+13 ms)Cleaning up detritus from prior splits at 1675796578622Running coprocessor post-open hooks at 1675796578630 (+8 ms)Region opened successfully at 1675796578630 2023-02-07 19:02:58,630 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff., pid=26, masterSystemTime=1675796578491 2023-02-07 19:02:58,634 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1 2023-02-07 19:02:58,634 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1 2023-02-07 19:02:58,635 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6986e39a4f96e5d8aa8f6416d3d9a2c6 columnFamilyName f1 2023-02-07 19:02:58,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-07 19:02:58,636 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(310): Store=6986e39a4f96e5d8aa8f6416d3d9a2c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 61486df234f2a47482b972d415e6e0bd, server=jenkins-hbase6.apache.org,39131,1675796574866 in 298 msec 2023-02-07 19:02:58,636 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9373da399ebea705ef68b02e1da07aff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,637 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:58,637 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578636"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578636"}]},"ts":"1675796578636"} 2023-02-07 19:02:58,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a077eee5fcca3c0df2ac9b6ea1b7e5ce, NAME => 'testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 19:02:58,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, ASSIGN in 473 msec 2023-02-07 19:02:58,641 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2 2023-02-07 19:02:58,641 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2 2023-02-07 19:02:58,643 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,644 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6986e39a4f96e5d8aa8f6416d3d9a2c6 columnFamilyName f2 2023-02-07 19:02:58,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-07 19:02:58,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 9373da399ebea705ef68b02e1da07aff, server=jenkins-hbase6.apache.org,37771,1675796574811 in 302 msec 2023-02-07 19:02:58,645 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(310): Store=6986e39a4f96e5d8aa8f6416d3d9a2c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,647 DEBUG [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f1 2023-02-07 19:02:58,647 DEBUG [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f1 2023-02-07 19:02:58,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, ASSIGN in 481 msec 2023-02-07 19:02:58,648 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a077eee5fcca3c0df2ac9b6ea1b7e5ce columnFamilyName f1 2023-02-07 19:02:58,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,649 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(310): Store=a077eee5fcca3c0df2ac9b6ea1b7e5ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,649 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,652 DEBUG [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f2 2023-02-07 19:02:58,652 DEBUG [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f2 2023-02-07 19:02:58,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,653 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a077eee5fcca3c0df2ac9b6ea1b7e5ce columnFamilyName f2 2023-02-07 19:02:58,653 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(310): Store=a077eee5fcca3c0df2ac9b6ea1b7e5ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:02:58,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 6986e39a4f96e5d8aa8f6416d3d9a2c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64145319, jitterRate=-0.04416026175022125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: Running coprocessor pre-open hook at 1675796578629Writing region info on filesystem at 1675796578629Initializing all the Stores at 1675796578630 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578630Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578630Cleaning up temporary data from old regions at 1675796578651 (+21 ms)Cleaning up detritus from prior splits at 1675796578651Running coprocessor post-open hooks at 1675796578658 (+7 ms)Region opened successfully at 1675796578658 2023-02-07 19:02:58,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6., pid=23, masterSystemTime=1675796578482 2023-02-07 19:02:58,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:02:58,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:58,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f338c6378a72d9f763afd7ba0b32438f, NAME => 'testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 19:02:58,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,664 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6986e39a4f96e5d8aa8f6416d3d9a2c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,664 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578663"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578663"}]},"ts":"1675796578663"} 2023-02-07 19:02:58,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened a077eee5fcca3c0df2ac9b6ea1b7e5ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65731857, jitterRate=-0.02051900327205658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: Running coprocessor pre-open hook at 1675796578640Writing region info on filesystem at 1675796578640Initializing all the Stores at 1675796578641 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578641Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578642 (+1 ms)Cleaning up temporary data from old regions at 1675796578657 (+15 ms)Cleaning up detritus from prior splits at 1675796578657Running coprocessor post-open hooks at 1675796578666 (+9 ms)Region opened successfully at 1675796578666 2023-02-07 19:02:58,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce., pid=27, masterSystemTime=1675796578491 2023-02-07 19:02:58,669 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:58,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2359dcea29fa95d230fbc0e4ee1168b7, NAME => 'testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 19:02:58,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:02:58,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,671 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1 2023-02-07 19:02:58,672 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1 2023-02-07 19:02:58,672 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f338c6378a72d9f763afd7ba0b32438f columnFamilyName f1 2023-02-07 19:02:58,673 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(310): Store=f338c6378a72d9f763afd7ba0b32438f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,673 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,673 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-07 19:02:58,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure 6986e39a4f96e5d8aa8f6416d3d9a2c6, server=jenkins-hbase6.apache.org,39131,1675796574866 in 335 msec 2023-02-07 19:02:58,675 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a077eee5fcca3c0df2ac9b6ea1b7e5ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,675 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796578675"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578675"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578675"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578675"}]},"ts":"1675796578675"} 2023-02-07 19:02:58,675 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1 2023-02-07 19:02:58,675 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1 2023-02-07 19:02:58,676 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2 2023-02-07 19:02:58,676 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2 2023-02-07 19:02:58,676 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2359dcea29fa95d230fbc0e4ee1168b7 columnFamilyName f1 2023-02-07 19:02:58,676 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f338c6378a72d9f763afd7ba0b32438f columnFamilyName f2 2023-02-07 19:02:58,677 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(310): Store=2359dcea29fa95d230fbc0e4ee1168b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,677 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(310): Store=f338c6378a72d9f763afd7ba0b32438f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,677 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, ASSIGN in 512 msec 2023-02-07 19:02:58,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,680 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2 2023-02-07 19:02:58,680 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2 2023-02-07 19:02:58,681 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2359dcea29fa95d230fbc0e4ee1168b7 columnFamilyName f2 2023-02-07 19:02:58,682 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(310): Store=2359dcea29fa95d230fbc0e4ee1168b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:02:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-07 19:02:58,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure a077eee5fcca3c0df2ac9b6ea1b7e5ce, server=jenkins-hbase6.apache.org,37771,1675796574811 in 337 msec 2023-02-07 19:02:58,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, ASSIGN in 521 msec 2023-02-07 19:02:58,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:02:58,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:02:58,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:02:58,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened f338c6378a72d9f763afd7ba0b32438f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69384920, jitterRate=0.03391587734222412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for f338c6378a72d9f763afd7ba0b32438f: Running coprocessor pre-open hook at 1675796578664Writing region info on filesystem at 1675796578664Initializing all the Stores at 1675796578666 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578666Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578669 (+3 ms)Cleaning up temporary data from old regions at 1675796578682 (+13 ms)Cleaning up detritus from prior splits at 1675796578683 (+1 ms)Running coprocessor post-open hooks at 1675796578691 (+8 ms)Region opened successfully at 1675796578691 2023-02-07 19:02:58,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f., pid=24, masterSystemTime=1675796578482 2023-02-07 19:02:58,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:02:58,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 2359dcea29fa95d230fbc0e4ee1168b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74424634, jitterRate=0.10901346802711487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:02:58,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 2359dcea29fa95d230fbc0e4ee1168b7: Running coprocessor pre-open hook at 1675796578671Writing region info on filesystem at 1675796578671Initializing all the Stores at 1675796578673 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578673Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796578673Cleaning up temporary data from old regions at 1675796578687 (+14 ms)Cleaning up detritus from prior splits at 1675796578687Running coprocessor post-open hooks at 1675796578694 (+7 ms)Region opened successfully at 1675796578694 2023-02-07 19:02:58,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:58,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7., pid=29, masterSystemTime=1675796578491 2023-02-07 19:02:58,696 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f338c6378a72d9f763afd7ba0b32438f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:58,696 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578695"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578695"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578695"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578695"}]},"ts":"1675796578695"} 2023-02-07 19:02:58,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:58,699 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2359dcea29fa95d230fbc0e4ee1168b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:58,699 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796578699"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796578699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796578699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796578699"}]},"ts":"1675796578699"} 2023-02-07 19:02:58,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-07 19:02:58,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure f338c6378a72d9f763afd7ba0b32438f, server=jenkins-hbase6.apache.org,39131,1675796574866 in 366 msec 2023-02-07 19:02:58,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, ASSIGN in 539 msec 2023-02-07 19:02:58,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-07 19:02:58,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure 2359dcea29fa95d230fbc0e4ee1168b7, server=jenkins-hbase6.apache.org,37771,1675796574811 in 356 msec 2023-02-07 19:02:58,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-07 19:02:58,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, ASSIGN in 541 msec 2023-02-07 19:02:58,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:02:58,710 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796578709"}]},"ts":"1675796578709"} 2023-02-07 19:02:58,712 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 19:02:58,809 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:02:58,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 975 msec 2023-02-07 19:02:59,011 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:59,012 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:59,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:02:59,015 INFO [Listener at localhost/39659] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 19:02:59,015 DEBUG [Listener at localhost/39659] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 19:02:59,017 INFO [Listener at localhost/39659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:02:59,026 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 19:02:59,027 INFO [Listener at localhost/39659] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:02:59,027 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 19:02:59,027 INFO [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:02:59,179 DEBUG [hconnection-0x4a477aff-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:02:59,235 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37182, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:02:59,267 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39131] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:59,477 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37771] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:59,629 INFO [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:02:59,633 INFO [Listener at localhost/39659] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:02:59,645 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:59,645 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:59,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:02:59,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796579649 (current time:1675796579649). 2023-02-07 19:02:59,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:02:59,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] zookeeper.ReadOnlyZKClient(139): Connect 0x7ad00e4b to 127.0.0.1:51055 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:02:59,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74fd4c31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:02:59,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:02:59,668 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:02:59,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ad00e4b to 127.0.0.1:51055 2023-02-07 19:02:59,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:02:59,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:02:59,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:02:59,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:02:59,695 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:02:59,697 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675797179697 2023-02-07 19:02:59,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:02:59,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 19:02:59,700 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:02:59,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:02:59,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 14 msec 2023-02-07 19:02:59,703 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:02:59,704 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:02:59,704 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:02:59,705 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675797179705 2023-02-07 19:02:59,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-07 19:02:59,752 INFO [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-07 19:02:59,753 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:02:59,753 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-07 19:02:59,753 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 19:02:59,754 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:02:59,754 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:02:59,756 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:02:59,756 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:02:59,756 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:02:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:02:59,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:02:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:02:59,757 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,757 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:02:59,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:02:59,757 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,757 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:02:59,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:02:59,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:02:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-07 19:02:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-07 19:02:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:02:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:02:59,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 19:02:59,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 19:02:59,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-07 19:02:59,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-07 19:02:59,761 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-07 19:02:59,761 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:02:59,761 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,37771,1675796574811' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-07 19:02:59,762 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39131,1675796574866' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-07 19:02:59,764 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,764 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,764 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,765 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:02:59,765 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,765 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,765 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:02:59,765 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:02:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:02:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39131,1675796574866' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-07 19:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f246616[Count = 1] remaining members to acquire global barrier 2023-02-07 19:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:02:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:02:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:02:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:02:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:02:59,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,37771,1675796574811' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-07 19:02:59,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f246616[Count = 0] remaining members to acquire global barrier 2023-02-07 19:02:59,771 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 19:02:59,771 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:02:59,772 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 19:02:59,773 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 19:02:59,773 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:02:59,773 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:02:59,773 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:02:59,774 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:59,774 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:02:59,774 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. started... 2023-02-07 19:02:59,774 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. started... 2023-02-07 19:02:59,775 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:02:59,775 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:02:59,775 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 19:02:59,775 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. started... 2023-02-07 19:02:59,775 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. started... 2023-02-07 19:02:59,775 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:02:59,775 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:02:59,776 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. started... 2023-02-07 19:02:59,777 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 19:02:59,777 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:59,777 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:02:59,777 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bf4ed18d3fe4cb6be11a1bb525169fa1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:02:59,777 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9373da399ebea705ef68b02e1da07aff 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:02:59,777 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3f5c43a26bd48348e32e6c0a6784f9bc 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 19:02:59,777 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f338c6378a72d9f763afd7ba0b32438f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:02:59,777 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. started... 2023-02-07 19:02:59,778 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 46d15b5564040f0b4eea5b4129443c80: 2023-02-07 19:02:59,778 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: 2023-02-07 19:02:59,780 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:02:59,780 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:02:59,786 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:02:59,786 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:02:59,791 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:02:59,791 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:02:59,791 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:02:59,791 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:02:59,804 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:02:59,804 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:02:59,805 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:02:59,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:02:59,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:02:59,815 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:02:59,831 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. completed. 2023-02-07 19:02:59,831 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:02:59,832 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:02:59,832 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 19:02:59,832 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. started... 2023-02-07 19:02:59,833 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2359dcea29fa95d230fbc0e4ee1168b7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:02:59,834 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. completed. 2023-02-07 19:02:59,834 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:02:59,835 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:02:59,835 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 19:02:59,835 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. started... 2023-02-07 19:02:59,836 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6986e39a4f96e5d8aa8f6416d3d9a2c6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 19:03:00,015 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:00,015 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:00,015 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:00,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:00,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:00,017 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 19:03:00,032 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f1/99daf7905099401bb3418a1b671eff2e 2023-02-07 19:03:00,033 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f1/d2549a0f9ed84df39e2b6689d6d694f6 2023-02-07 19:03:00,033 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f1/b76f9d164fe343029d31e15c3b9cad88 2023-02-07 19:03:00,040 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d 2023-02-07 19:03:00,040 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f1/ec9bce8274854790b586781cb6fda696 2023-02-07 19:03:00,040 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f1/96b1b2c7354b41a4b8eac7e7540341fa 2023-02-07 19:03:00,199 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f2/07ad5e9b1b4842d7b9c71adc04e89a89 2023-02-07 19:03:00,227 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f2/1a79fc01f51542bfb73a5b4a390b9748 2023-02-07 19:03:00,232 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f1/99daf7905099401bb3418a1b671eff2e as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/99daf7905099401bb3418a1b671eff2e 2023-02-07 19:03:00,238 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f2/2091b128a4844b02a156110b854f6517 2023-02-07 19:03:00,239 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f2/3b2c5d84486349e4ae01d6af76ae9b9f 2023-02-07 19:03:00,240 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f2/c1aa667d7ab84e61a19ed9233033cd79 2023-02-07 19:03:00,242 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f2/e471ce04c212441ab27dfa1af23eecd2 2023-02-07 19:03:00,248 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f1/b76f9d164fe343029d31e15c3b9cad88 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/b76f9d164fe343029d31e15c3b9cad88 2023-02-07 19:03:00,253 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/99daf7905099401bb3418a1b671eff2e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:00,256 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f1/ec9bce8274854790b586781cb6fda696 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/ec9bce8274854790b586781cb6fda696 2023-02-07 19:03:00,256 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f1/d2549a0f9ed84df39e2b6689d6d694f6 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/d2549a0f9ed84df39e2b6689d6d694f6 2023-02-07 19:03:00,257 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f2/07ad5e9b1b4842d7b9c71adc04e89a89 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/07ad5e9b1b4842d7b9c71adc04e89a89 2023-02-07 19:03:00,259 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f1/96b1b2c7354b41a4b8eac7e7540341fa as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/96b1b2c7354b41a4b8eac7e7540341fa 2023-02-07 19:03:00,261 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d 2023-02-07 19:03:00,264 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/b76f9d164fe343029d31e15c3b9cad88, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:00,267 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f2/1a79fc01f51542bfb73a5b4a390b9748 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/1a79fc01f51542bfb73a5b4a390b9748 2023-02-07 19:03:00,271 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/ec9bce8274854790b586781cb6fda696, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,275 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f2/c1aa667d7ab84e61a19ed9233033cd79 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/c1aa667d7ab84e61a19ed9233033cd79 2023-02-07 19:03:00,275 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/96b1b2c7354b41a4b8eac7e7540341fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,277 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/d2549a0f9ed84df39e2b6689d6d694f6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,278 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f2/2091b128a4844b02a156110b854f6517 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/2091b128a4844b02a156110b854f6517 2023-02-07 19:03:00,280 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,280 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f2/3b2c5d84486349e4ae01d6af76ae9b9f as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3b2c5d84486349e4ae01d6af76ae9b9f 2023-02-07 19:03:00,283 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/07ad5e9b1b4842d7b9c71adc04e89a89, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:00,283 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f2/e471ce04c212441ab27dfa1af23eecd2 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/e471ce04c212441ab27dfa1af23eecd2 2023-02-07 19:03:00,285 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3f5c43a26bd48348e32e6c0a6784f9bc in 508ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,285 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/1a79fc01f51542bfb73a5b4a390b9748, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:00,287 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 19:03:00,287 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6986e39a4f96e5d8aa8f6416d3d9a2c6 in 451ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,287 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 19:03:00,288 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/c1aa667d7ab84e61a19ed9233033cd79, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,290 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3f5c43a26bd48348e32e6c0a6784f9bc: 2023-02-07 19:03:00,290 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bf4ed18d3fe4cb6be11a1bb525169fa1 in 513ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,290 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,291 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: 2023-02-07 19:03:00,291 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,292 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/99daf7905099401bb3418a1b671eff2e] hfiles 2023-02-07 19:03:00,291 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,292 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,292 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/b76f9d164fe343029d31e15c3b9cad88] hfiles 2023-02-07 19:03:00,292 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/b76f9d164fe343029d31e15c3b9cad88 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,291 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bf4ed18d3fe4cb6be11a1bb525169fa1: 2023-02-07 19:03:00,294 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,294 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,292 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/99daf7905099401bb3418a1b671eff2e for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,294 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/ec9bce8274854790b586781cb6fda696] hfiles 2023-02-07 19:03:00,294 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/ec9bce8274854790b586781cb6fda696 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,296 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/e471ce04c212441ab27dfa1af23eecd2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,297 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f338c6378a72d9f763afd7ba0b32438f in 520ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,297 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f338c6378a72d9f763afd7ba0b32438f: 2023-02-07 19:03:00,297 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,297 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,297 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d] hfiles 2023-02-07 19:03:00,297 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,298 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/c1aa667d7ab84e61a19ed9233033cd79] hfiles 2023-02-07 19:03:00,298 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/c1aa667d7ab84e61a19ed9233033cd79 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,298 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/07ad5e9b1b4842d7b9c71adc04e89a89] hfiles 2023-02-07 19:03:00,298 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/07ad5e9b1b4842d7b9c71adc04e89a89 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,298 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/1a79fc01f51542bfb73a5b4a390b9748] hfiles 2023-02-07 19:03:00,298 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/e471ce04c212441ab27dfa1af23eecd2] hfiles 2023-02-07 19:03:00,299 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/e471ce04c212441ab27dfa1af23eecd2 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,299 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/1a79fc01f51542bfb73a5b4a390b9748 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,306 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3b2c5d84486349e4ae01d6af76ae9b9f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,307 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2359dcea29fa95d230fbc0e4ee1168b7 in 474ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2359dcea29fa95d230fbc0e4ee1168b7: 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/d2549a0f9ed84df39e2b6689d6d694f6] hfiles 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/d2549a0f9ed84df39e2b6689d6d694f6 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3b2c5d84486349e4ae01d6af76ae9b9f] hfiles 2023-02-07 19:03:00,307 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3b2c5d84486349e4ae01d6af76ae9b9f for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,317 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:00,318 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:00,318 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:00,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:00,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:00,320 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 19:03:00,320 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/2091b128a4844b02a156110b854f6517, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,321 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9373da399ebea705ef68b02e1da07aff in 544ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,321 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9373da399ebea705ef68b02e1da07aff: 2023-02-07 19:03:00,322 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,322 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,322 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/96b1b2c7354b41a4b8eac7e7540341fa] hfiles 2023-02-07 19:03:00,322 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/96b1b2c7354b41a4b8eac7e7540341fa for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,322 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/2091b128a4844b02a156110b854f6517] hfiles 2023-02-07 19:03:00,322 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/2091b128a4844b02a156110b854f6517 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,400 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. completed. 2023-02-07 19:03:00,400 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:00,400 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:00,401 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. started... 2023-02-07 19:03:00,414 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 19:03:00,416 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 61486df234f2a47482b972d415e6e0bd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:00,420 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. completed. 2023-02-07 19:03:00,420 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:00,421 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. completed. 2023-02-07 19:03:00,421 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:00,421 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:00,421 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. started... 2023-02-07 19:03:00,421 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 19:03:00,422 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 19:03:00,423 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 99fa7a707c08f867ed590c773e5e4af7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:00,425 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. completed. 2023-02-07 19:03:00,425 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:00,425 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 19:03:00,447 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f1/9ffa7b8ffe98409c904deeabbc940009 2023-02-07 19:03:00,452 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f1/df571cbee04a4fca9acf7d802b0fb5a9 2023-02-07 19:03:00,507 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f2/696efd2cb2124777b3d1ce85c812b019 2023-02-07 19:03:00,519 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f1/9ffa7b8ffe98409c904deeabbc940009 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/9ffa7b8ffe98409c904deeabbc940009 2023-02-07 19:03:00,527 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f2/3b282054af494fd783a256ac9235d761 2023-02-07 19:03:00,529 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/9ffa7b8ffe98409c904deeabbc940009, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,531 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f2/696efd2cb2124777b3d1ce85c812b019 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/696efd2cb2124777b3d1ce85c812b019 2023-02-07 19:03:00,539 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f1/df571cbee04a4fca9acf7d802b0fb5a9 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/df571cbee04a4fca9acf7d802b0fb5a9 2023-02-07 19:03:00,541 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/696efd2cb2124777b3d1ce85c812b019, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,542 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 61486df234f2a47482b972d415e6e0bd in 126ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 61486df234f2a47482b972d415e6e0bd: 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/9ffa7b8ffe98409c904deeabbc940009] hfiles 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/9ffa7b8ffe98409c904deeabbc940009 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/696efd2cb2124777b3d1ce85c812b019] hfiles 2023-02-07 19:03:00,543 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/696efd2cb2124777b3d1ce85c812b019 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,547 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/df571cbee04a4fca9acf7d802b0fb5a9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,548 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f2/3b282054af494fd783a256ac9235d761 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/3b282054af494fd783a256ac9235d761 2023-02-07 19:03:00,558 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/3b282054af494fd783a256ac9235d761, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:00,559 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 99fa7a707c08f867ed590c773e5e4af7 in 136ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:00,559 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 99fa7a707c08f867ed590c773e5e4af7: 2023-02-07 19:03:00,560 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,560 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:00,560 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/df571cbee04a4fca9acf7d802b0fb5a9] hfiles 2023-02-07 19:03:00,560 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/df571cbee04a4fca9acf7d802b0fb5a9 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,560 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/3b282054af494fd783a256ac9235d761] hfiles 2023-02-07 19:03:00,560 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/3b282054af494fd783a256ac9235d761 for snapshot=testWithMapReduceMultiRegion 2023-02-07 19:03:00,567 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. completed. 2023-02-07 19:03:00,567 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:00,567 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 19:03:00,567 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 19:03:00,567 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,567 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-07 19:03:00,567 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,39131,1675796574866' in zk 2023-02-07 19:03:00,572 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-07 19:03:00,572 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,572 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:00,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:00,572 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-07 19:03:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,39131,1675796574866': 2023-02-07 19:03:00,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39131,1675796574866' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 19:03:00,582 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. completed. 2023-02-07 19:03:00,582 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:00,582 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 19:03:00,820 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:00,820 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:00,820 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:00,821 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. completed. 2023-02-07 19:03:00,821 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:00,821 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 19:03:00,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:00,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:00,822 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-07 19:03:00,824 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. completed. 2023-02-07 19:03:00,824 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:00,824 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 19:03:00,824 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 19:03:00,824 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,824 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-07 19:03:00,824 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,37771,1675796574811' in zk 2023-02-07 19:03:00,827 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,827 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-07 19:03:00,827 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:00,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:00,827 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-07 19:03:00,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:00,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:00,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:00,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:00,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,37771,1675796574811': 2023-02-07 19:03:00,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,37771,1675796574811' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:00,833 INFO [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-07 19:03:00,833 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:00,833 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:00,833 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-07 19:03:00,833 INFO [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:00,836 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,836 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:00,836 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:00,836 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,836 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:00,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,838 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:00,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,839 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:00,847 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 19:03:00,847 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:00,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:00,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:00,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:00,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:00,862 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:00,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-07 19:03:00,861 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:00,863 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 19:03:00,863 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:00,863 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:03:00,863 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:00,863 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 19:03:00,863 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 19:03:00,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:00,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:00,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 19:03:00,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-07 19:03:01,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-07 19:03:01,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 19:03:01,082 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 19:03:01,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675796579698Consolidate snapshot: testWithMapReduceMultiRegion at 1675796580862 (+1164 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675796580863 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1675796580891 (+28 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675796580926 (+35 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675796581081 (+155 ms) 2023-02-07 19:03:01,084 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:01,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3840 sec 2023-02-07 19:03:01,823 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:01,823 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:01,823 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:01,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:01,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:01,825 INFO [Listener at localhost/39659] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:01,826 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:01,826 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:01,841 INFO [Listener at localhost/39659] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:01,855 INFO [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:01,926 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39131] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:01,928 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37771] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:02,096 INFO [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:02,110 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:02,111 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:02,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:02,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 19:03:02,119 INFO [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 19:03:02,119 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:02,120 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 19:03:02,120 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 19:03:02,121 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,121 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,122 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:02,122 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:02,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:02,122 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:02,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:02,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:02,123 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,123 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,123 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,124 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 19:03:02,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 19:03:02,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 19:03:02,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 19:03:02,130 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 19:03:02,130 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:02,131 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 19:03:02,131 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 19:03:02,131 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:02,132 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 19:03:02,137 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:02,137 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:02,137 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:02,137 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. started... 2023-02-07 19:03:02,137 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 19:03:02,138 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:02,137 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. started... 2023-02-07 19:03:02,138 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bf4ed18d3fe4cb6be11a1bb525169fa1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:02,137 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. started... 2023-02-07 19:03:02,138 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 19:03:02,138 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. started... 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 46d15b5564040f0b4eea5b4129443c80: 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:02,138 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f338c6378a72d9f763afd7ba0b32438f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:02,139 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. started... 2023-02-07 19:03:02,138 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9373da399ebea705ef68b02e1da07aff 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:02,139 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3f5c43a26bd48348e32e6c0a6784f9bc 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 19:03:02,139 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:02,138 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:02,139 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. started... 2023-02-07 19:03:02,139 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. started... 2023-02-07 19:03:02,140 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: 2023-02-07 19:03:02,141 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:02,141 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:02,141 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 19:03:02,141 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. started... 2023-02-07 19:03:02,141 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2359dcea29fa95d230fbc0e4ee1168b7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:02,142 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6986e39a4f96e5d8aa8f6416d3d9a2c6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 19:03:02,185 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f1/72e811c736634d718fb585657715852d 2023-02-07 19:03:02,217 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f1/5bb4d4792cae4a5fa1223e76c5403437 2023-02-07 19:03:02,224 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f1/bbf6ba55390d4fc68d6bb3db3714517e 2023-02-07 19:03:02,228 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 19:03:02,242 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f1/455b1ca1c6084f02a9114737311d661e 2023-02-07 19:03:02,247 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f1/0ff5656c533745ff8a342d4da1861942 2023-02-07 19:03:02,287 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f2/0622a67d56b540a48f692dbb6377fe54 2023-02-07 19:03:02,300 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f2/f853a4dc4c214063b771add12bc1c716 2023-02-07 19:03:02,309 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f1/72e811c736634d718fb585657715852d as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/72e811c736634d718fb585657715852d 2023-02-07 19:03:02,311 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f1/5bb4d4792cae4a5fa1223e76c5403437 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/5bb4d4792cae4a5fa1223e76c5403437 2023-02-07 19:03:02,320 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/72e811c736634d718fb585657715852d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,323 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f2/68c47e4447884a0fb60af49114131647 2023-02-07 19:03:02,323 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/.tmp/f2/0622a67d56b540a48f692dbb6377fe54 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/0622a67d56b540a48f692dbb6377fe54 2023-02-07 19:03:02,325 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/5bb4d4792cae4a5fa1223e76c5403437, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,325 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f2/3ad5f5d9090e489ab3331d78c6324c8a 2023-02-07 19:03:02,328 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/.tmp/f2/f853a4dc4c214063b771add12bc1c716 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/f853a4dc4c214063b771add12bc1c716 2023-02-07 19:03:02,330 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f2/636061b34e5e476fa7640b8412927c4a 2023-02-07 19:03:02,335 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f1/455b1ca1c6084f02a9114737311d661e as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/455b1ca1c6084f02a9114737311d661e 2023-02-07 19:03:02,338 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f1/bbf6ba55390d4fc68d6bb3db3714517e as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/bbf6ba55390d4fc68d6bb3db3714517e 2023-02-07 19:03:02,343 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/f853a4dc4c214063b771add12bc1c716, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,344 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f1/0ff5656c533745ff8a342d4da1861942 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/0ff5656c533745ff8a342d4da1861942 2023-02-07 19:03:02,345 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bf4ed18d3fe4cb6be11a1bb525169fa1 in 208ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,346 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bf4ed18d3fe4cb6be11a1bb525169fa1: 2023-02-07 19:03:02,346 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:02,346 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:02,346 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 19:03:02,346 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. started... 2023-02-07 19:03:02,347 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 61486df234f2a47482b972d415e6e0bd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:02,350 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/0622a67d56b540a48f692dbb6377fe54, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,350 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/bbf6ba55390d4fc68d6bb3db3714517e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,351 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f338c6378a72d9f763afd7ba0b32438f in 213ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,352 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f338c6378a72d9f763afd7ba0b32438f: 2023-02-07 19:03:02,352 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:02,352 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 19:03:02,352 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/.tmp/f2/3ad5f5d9090e489ab3331d78c6324c8a as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3ad5f5d9090e489ab3331d78c6324c8a 2023-02-07 19:03:02,353 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/455b1ca1c6084f02a9114737311d661e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,354 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/.tmp/f2/68c47e4447884a0fb60af49114131647 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/68c47e4447884a0fb60af49114131647 2023-02-07 19:03:02,362 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 19:03:02,363 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 19:03:02,370 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3ad5f5d9090e489ab3331d78c6324c8a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,372 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/0ff5656c533745ff8a342d4da1861942, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:02,373 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/68c47e4447884a0fb60af49114131647, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,374 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2359dcea29fa95d230fbc0e4ee1168b7 in 233ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,374 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9373da399ebea705ef68b02e1da07aff in 236ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,374 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2359dcea29fa95d230fbc0e4ee1168b7: 2023-02-07 19:03:02,374 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9373da399ebea705ef68b02e1da07aff: 2023-02-07 19:03:02,375 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:02,375 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:02,375 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 19:03:02,375 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:02,375 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 19:03:02,375 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. started... 2023-02-07 19:03:02,375 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/.tmp/f2/636061b34e5e476fa7640b8412927c4a as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/636061b34e5e476fa7640b8412927c4a 2023-02-07 19:03:02,375 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 99fa7a707c08f867ed590c773e5e4af7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:02,383 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/636061b34e5e476fa7640b8412927c4a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:02,384 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3f5c43a26bd48348e32e6c0a6784f9bc in 245ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,384 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3f5c43a26bd48348e32e6c0a6784f9bc: 2023-02-07 19:03:02,385 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:02,385 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 19:03:02,395 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f1/dcc4c3327ec04a3f99bb57ade531a9ef 2023-02-07 19:03:02,413 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f1/70f6d32127424d36b3bf60950c6b3270 2023-02-07 19:03:02,428 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f2/a37c6955567a4aa18bf07946a9c3a997 2023-02-07 19:03:02,435 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f1/dcc4c3327ec04a3f99bb57ade531a9ef as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/dcc4c3327ec04a3f99bb57ade531a9ef 2023-02-07 19:03:02,442 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/dcc4c3327ec04a3f99bb57ade531a9ef, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,443 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f2/f6ed01a813f84186b0aea71a0188d53f 2023-02-07 19:03:02,444 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/.tmp/f2/a37c6955567a4aa18bf07946a9c3a997 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/a37c6955567a4aa18bf07946a9c3a997 2023-02-07 19:03:02,451 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f1/70f6d32127424d36b3bf60950c6b3270 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/70f6d32127424d36b3bf60950c6b3270 2023-02-07 19:03:02,451 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/a37c6955567a4aa18bf07946a9c3a997, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,453 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 61486df234f2a47482b972d415e6e0bd in 107ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,453 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 61486df234f2a47482b972d415e6e0bd: 2023-02-07 19:03:02,453 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:02,453 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 19:03:02,460 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/70f6d32127424d36b3bf60950c6b3270, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,461 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/.tmp/f2/f6ed01a813f84186b0aea71a0188d53f as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/f6ed01a813f84186b0aea71a0188d53f 2023-02-07 19:03:02,469 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/f6ed01a813f84186b0aea71a0188d53f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:02,470 INFO [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 99fa7a707c08f867ed590c773e5e4af7 in 95ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,470 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 99fa7a707c08f867ed590c773e5e4af7: 2023-02-07 19:03:02,470 DEBUG [rs(jenkins-hbase6.apache.org,37771,1675796574811)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:02,470 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 19:03:02,470 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 19:03:02,470 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,470 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 19:03:02,470 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,37771,1675796574811' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 19:03:02,473 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,473 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,37771,1675796574811' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 19:03:02,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@106dc4dc[Count = 1] remaining members to acquire global barrier 2023-02-07 19:03:02,632 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f1/7db8c5c5f2f2414e8a697683068c415c 2023-02-07 19:03:02,649 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f2/d8c53070df8d4239b3d5f1c29ca78c7f 2023-02-07 19:03:02,655 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f1/7db8c5c5f2f2414e8a697683068c415c as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/7db8c5c5f2f2414e8a697683068c415c 2023-02-07 19:03:02,662 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/7db8c5c5f2f2414e8a697683068c415c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:02,663 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/.tmp/f2/d8c53070df8d4239b3d5f1c29ca78c7f as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/d8c53070df8d4239b3d5f1c29ca78c7f 2023-02-07 19:03:02,670 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/d8c53070df8d4239b3d5f1c29ca78c7f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:02,671 INFO [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6986e39a4f96e5d8aa8f6416d3d9a2c6 in 532ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:02,671 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: 2023-02-07 19:03:02,671 DEBUG [rs(jenkins-hbase6.apache.org,39131,1675796574866)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:02,671 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 19:03:02,671 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 19:03:02,671 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,672 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 19:03:02,672 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39131,1675796574866' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 19:03:02,674 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,674 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:02,675 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,675 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:02,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39131,1675796574866' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 19:03:02,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@106dc4dc[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:02,677 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 19:03:02,677 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,680 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 19:03:02,680 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 19:03:02,680 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,680 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 19:03:02,680 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,39131,1675796574866' in zk 2023-02-07 19:03:02,680 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 19:03:02,680 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,37771,1675796574811' in zk 2023-02-07 19:03:02,680 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,680 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:02,682 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 19:03:02,682 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,682 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:02,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:02,683 DEBUG [member: 'jenkins-hbase6.apache.org,39131,1675796574866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 19:03:02,683 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 19:03:02,684 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:02,684 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:02,684 DEBUG [member: 'jenkins-hbase6.apache.org,37771,1675796574811' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 19:03:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,39131,1675796574866': 2023-02-07 19:03:02,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39131,1675796574866' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-07 19:03:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:02,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,37771,1675796574811': 2023-02-07 19:03:02,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,37771,1675796574811' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 19:03:02,693 INFO [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 19:03:02,693 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:02,693 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:02,693 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 19:03:02,693 INFO [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:02,696 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,696 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,696 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:02,696 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,696 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:02,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:02,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:02,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,698 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:02,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,699 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,701 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:02,701 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:02,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:02,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:02,709 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:02,709 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,709 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:02,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:02,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:02,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 19:03:02,708 DEBUG [(jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:02,708 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:02,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:02,709 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:02,712 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:02,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:02,712 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:02,712 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:02,812 DEBUG [Listener at localhost/39659] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:02,813 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:02,813 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:02,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:02,923 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop-1034318529695590865.jar 2023-02-07 19:03:02,940 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675796579649 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:02,941 DEBUG [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce 2023-02-07 19:03:02,942 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:02,942 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(239): region to add: 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=9373da399ebea705ef68b02e1da07aff as 9373da399ebea705ef68b02e1da07aff in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=46d15b5564040f0b4eea5b4129443c80 as 46d15b5564040f0b4eea5b4129443c80 in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,943 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=3f5c43a26bd48348e32e6c0a6784f9bc as 3f5c43a26bd48348e32e6c0a6784f9bc in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=bf4ed18d3fe4cb6be11a1bb525169fa1 as bf4ed18d3fe4cb6be11a1bb525169fa1 in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=a077eee5fcca3c0df2ac9b6ea1b7e5ce as a077eee5fcca3c0df2ac9b6ea1b7e5ce in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=f338c6378a72d9f763afd7ba0b32438f as f338c6378a72d9f763afd7ba0b32438f in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=6986e39a4f96e5d8aa8f6416d3d9a2c6 as 6986e39a4f96e5d8aa8f6416d3d9a2c6 in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=2359dcea29fa95d230fbc0e4ee1168b7 as 2359dcea29fa95d230fbc0e4ee1168b7 in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=61486df234f2a47482b972d415e6e0bd as 61486df234f2a47482b972d415e6e0bd in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,944 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(585): clone region=99fa7a707c08f867ed590c773e5e4af7 as 99fa7a707c08f867ed590c773e5e4af7 in snapshot testWithMapReduceMultiRegion 2023-02-07 19:03:02,950 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => f338c6378a72d9f763afd7ba0b32438f, NAME => 'testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,950 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => bf4ed18d3fe4cb6be11a1bb525169fa1, NAME => 'testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,951 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 46d15b5564040f0b4eea5b4129443c80, NAME => 'testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,952 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3f5c43a26bd48348e32e6c0a6784f9bc, NAME => 'testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,952 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => a077eee5fcca3c0df2ac9b6ea1b7e5ce, NAME => 'testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,952 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2359dcea29fa95d230fbc0e4ee1168b7, NAME => 'testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,953 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 6986e39a4f96e5d8aa8f6416d3d9a2c6, NAME => 'testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,953 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9373da399ebea705ef68b02e1da07aff, NAME => 'testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:02,986 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:02,986 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a709cfbf7e6a4ba5ae5d954e57fdd25d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:02,998 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:02,998 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:02,998 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 99daf7905099401bb3418a1b671eff2e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:02,998 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 46d15b5564040f0b4eea5b4129443c80, disabling compactions & flushes 2023-02-07 19:03:02,998 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:02,999 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:02,999 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. after waiting 0 ms 2023-02-07 19:03:02,999 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:02,999 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:02,999 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 46d15b5564040f0b4eea5b4129443c80: Waiting for close lock at 1675796582998Disabling compacts and flushes for region at 1675796582998Disabling writes for close at 1675796582999 (+1 ms)Writing region close event to WAL at 1675796582999Closed at 1675796582999 2023-02-07 19:03:03,000 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 61486df234f2a47482b972d415e6e0bd, NAME => 'testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:03,010 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e471ce04c212441ab27dfa1af23eecd2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,027 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,027 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 07ad5e9b1b4842d7b9c71adc04e89a89 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,027 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing a077eee5fcca3c0df2ac9b6ea1b7e5ce, disabling compactions & flushes 2023-02-07 19:03:03,027 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,027 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:03,027 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:03,027 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b76f9d164fe343029d31e15c3b9cad88 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,027 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. after waiting 0 ms 2023-02-07 19:03:03,028 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:03,028 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:03,028 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: Waiting for close lock at 1675796583027Disabling compacts and flushes for region at 1675796583027Disabling writes for close at 1675796583028 (+1 ms)Writing region close event to WAL at 1675796583028Closed at 1675796583028 2023-02-07 19:03:03,028 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 99fa7a707c08f867ed590c773e5e4af7, NAME => 'testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:03,034 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing f338c6378a72d9f763afd7ba0b32438f, disabling compactions & flushes 2023-02-07 19:03:03,034 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:03,035 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:03,035 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. after waiting 0 ms 2023-02-07 19:03:03,035 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:03,035 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:03,035 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,035 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for f338c6378a72d9f763afd7ba0b32438f: Waiting for close lock at 1675796583034Disabling compacts and flushes for region at 1675796583034Disabling writes for close at 1675796583035 (+1 ms)Writing region close event to WAL at 1675796583035Closed at 1675796583035 2023-02-07 19:03:03,035 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ec9bce8274854790b586781cb6fda696 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,035 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,035 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96b1b2c7354b41a4b8eac7e7540341fa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,045 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 3f5c43a26bd48348e32e6c0a6784f9bc, disabling compactions & flushes 2023-02-07 19:03:03,045 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:03,045 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:03,046 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. after waiting 0 ms 2023-02-07 19:03:03,046 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:03,046 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:03,046 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 3f5c43a26bd48348e32e6c0a6784f9bc: Waiting for close lock at 1675796583045Disabling compacts and flushes for region at 1675796583045Disabling writes for close at 1675796583046 (+1 ms)Writing region close event to WAL at 1675796583046Closed at 1675796583046 2023-02-07 19:03:03,048 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c1aa667d7ab84e61a19ed9233033cd79 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,048 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2091b128a4844b02a156110b854f6517 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,048 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1a79fc01f51542bfb73a5b4a390b9748 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing bf4ed18d3fe4cb6be11a1bb525169fa1, disabling compactions & flushes 2023-02-07 19:03:03,064 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. after waiting 0 ms 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:03,064 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for bf4ed18d3fe4cb6be11a1bb525169fa1: Waiting for close lock at 1675796583063Disabling compacts and flushes for region at 1675796583063Disabling writes for close at 1675796583064 (+1 ms)Writing region close event to WAL at 1675796583064Closed at 1675796583064 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9373da399ebea705ef68b02e1da07aff, disabling compactions & flushes 2023-02-07 19:03:03,064 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,065 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:03,065 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ffa7b8ffe98409c904deeabbc940009 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 6986e39a4f96e5d8aa8f6416d3d9a2c6, disabling compactions & flushes 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. after waiting 0 ms 2023-02-07 19:03:03,065 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:03,065 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. after waiting 0 ms 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:03,066 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:03,066 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: Waiting for close lock at 1675796583065Disabling compacts and flushes for region at 1675796583065Disabling writes for close at 1675796583065Writing region close event to WAL at 1675796583066 (+1 ms)Closed at 1675796583066 2023-02-07 19:03:03,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9373da399ebea705ef68b02e1da07aff: Waiting for close lock at 1675796583064Disabling compacts and flushes for region at 1675796583064Disabling writes for close at 1675796583065 (+1 ms)Writing region close event to WAL at 1675796583065Closed at 1675796583065 2023-02-07 19:03:03,072 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 696efd2cb2124777b3d1ce85c812b019 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,075 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,075 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 61486df234f2a47482b972d415e6e0bd, disabling compactions & flushes 2023-02-07 19:03:03,075 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink df571cbee04a4fca9acf7d802b0fb5a9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,075 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:03,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:03,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. after waiting 0 ms 2023-02-07 19:03:03,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:03,076 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:03,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 61486df234f2a47482b972d415e6e0bd: Waiting for close lock at 1675796583075Disabling compacts and flushes for region at 1675796583075Disabling writes for close at 1675796583076 (+1 ms)Writing region close event to WAL at 1675796583076Closed at 1675796583076 2023-02-07 19:03:03,078 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b282054af494fd783a256ac9235d761 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,080 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 99fa7a707c08f867ed590c773e5e4af7, disabling compactions & flushes 2023-02-07 19:03:03,080 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:03,080 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:03,080 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. after waiting 0 ms 2023-02-07 19:03:03,080 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:03,080 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:03,080 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 99fa7a707c08f867ed590c773e5e4af7: Waiting for close lock at 1675796583080Disabling compacts and flushes for region at 1675796583080Disabling writes for close at 1675796583080Writing region close event to WAL at 1675796583080Closed at 1675796583080 2023-02-07 19:03:03,444 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:03,444 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2549a0f9ed84df39e2b6689d6d694f6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,447 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b2c5d84486349e4ae01d6af76ae9b9f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 19:03:03,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2359dcea29fa95d230fbc0e4ee1168b7, disabling compactions & flushes 2023-02-07 19:03:03,450 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:03,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:03,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. after waiting 0 ms 2023-02-07 19:03:03,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:03,450 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:03,450 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2359dcea29fa95d230fbc0e4ee1168b7: Waiting for close lock at 1675796583450Disabling compacts and flushes for region at 1675796583450Disabling writes for close at 1675796583450Writing region close event to WAL at 1675796583450Closed at 1675796583450 2023-02-07 19:03:03,451 INFO [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675796579649 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:03,451 DEBUG [Listener at localhost/39659] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:03,451 DEBUG [Listener at localhost/39659] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09 2023-02-07 19:03:03,452 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:03,453 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:03,453 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 19:03:03,454 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------2359dcea29fa95d230fbc0e4ee1168b7/ 2023-02-07 19:03:03,454 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,454 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,455 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=2359dcea29fa95d230fbc0e4ee1168b7-d2549a0f9ed84df39e2b6689d6d694f6 2023-02-07 19:03:03,455 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,456 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=2359dcea29fa95d230fbc0e4ee1168b7-3b2c5d84486349e4ae01d6af76ae9b9f 2023-02-07 19:03:03,456 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------3f5c43a26bd48348e32e6c0a6784f9bc/ 2023-02-07 19:03:03,456 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,456 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,457 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=3f5c43a26bd48348e32e6c0a6784f9bc-99daf7905099401bb3418a1b671eff2e 2023-02-07 19:03:03,457 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,457 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=3f5c43a26bd48348e32e6c0a6784f9bc-07ad5e9b1b4842d7b9c71adc04e89a89 2023-02-07 19:03:03,458 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------46d15b5564040f0b4eea5b4129443c80/ 2023-02-07 19:03:03,458 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,458 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------61486df234f2a47482b972d415e6e0bd/ 2023-02-07 19:03:03,459 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,459 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,459 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=61486df234f2a47482b972d415e6e0bd-9ffa7b8ffe98409c904deeabbc940009 2023-02-07 19:03:03,459 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,460 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=61486df234f2a47482b972d415e6e0bd-696efd2cb2124777b3d1ce85c812b019 2023-02-07 19:03:03,460 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------6986e39a4f96e5d8aa8f6416d3d9a2c6/ 2023-02-07 19:03:03,460 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,460 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,461 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=6986e39a4f96e5d8aa8f6416d3d9a2c6-b76f9d164fe343029d31e15c3b9cad88 2023-02-07 19:03:03,461 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,462 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=6986e39a4f96e5d8aa8f6416d3d9a2c6-1a79fc01f51542bfb73a5b4a390b9748 2023-02-07 19:03:03,462 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------9373da399ebea705ef68b02e1da07aff/ 2023-02-07 19:03:03,462 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,462 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,463 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=9373da399ebea705ef68b02e1da07aff-96b1b2c7354b41a4b8eac7e7540341fa 2023-02-07 19:03:03,463 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,463 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=9373da399ebea705ef68b02e1da07aff-2091b128a4844b02a156110b854f6517 2023-02-07 19:03:03,464 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------99fa7a707c08f867ed590c773e5e4af7/ 2023-02-07 19:03:03,464 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,464 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,465 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=99fa7a707c08f867ed590c773e5e4af7-df571cbee04a4fca9acf7d802b0fb5a9 2023-02-07 19:03:03,465 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,465 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=99fa7a707c08f867ed590c773e5e4af7-3b282054af494fd783a256ac9235d761 2023-02-07 19:03:03,465 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------a077eee5fcca3c0df2ac9b6ea1b7e5ce/ 2023-02-07 19:03:03,466 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,466 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------bf4ed18d3fe4cb6be11a1bb525169fa1/ 2023-02-07 19:03:03,466 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,467 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,467 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=bf4ed18d3fe4cb6be11a1bb525169fa1-ec9bce8274854790b586781cb6fda696 2023-02-07 19:03:03,467 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,467 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=bf4ed18d3fe4cb6be11a1bb525169fa1-c1aa667d7ab84e61a19ed9233033cd79 2023-02-07 19:03:03,468 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |----------f338c6378a72d9f763afd7ba0b32438f/ 2023-02-07 19:03:03,468 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:03,468 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:03,469 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=f338c6378a72d9f763afd7ba0b32438f-a709cfbf7e6a4ba5ae5d954e57fdd25d 2023-02-07 19:03:03,469 DEBUG [Listener at localhost/39659] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:03,469 DEBUG [Listener at localhost/39659] util.CommonFSUtils(702): |----------------testWithMapReduce=f338c6378a72d9f763afd7ba0b32438f-e471ce04c212441ab27dfa1af23eecd2 2023-02-07 19:03:03,477 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,478 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,478 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,479 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,479 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,480 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,480 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,579 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop-7044762911086753131.jar 2023-02-07 19:03:03,579 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,580 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,580 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,580 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,581 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,581 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,582 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 19:03:03,582 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 19:03:03,583 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 19:03:03,583 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 19:03:03,583 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 19:03:03,584 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 19:03:03,584 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 19:03:03,585 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 19:03:03,585 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 19:03:03,586 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 19:03:03,591 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:03,591 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:03,592 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:03,592 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:03,592 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 19:03:03,663 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop-5447474032973180310.jar 2023-02-07 19:03:03,663 DEBUG [Listener at localhost/39659] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 19:03:03,709 WARN [Listener at localhost/39659] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 19:03:03,759 INFO [Listener at localhost/39659] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 19:03:03,782 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:03,783 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-07 19:03:04,118 WARN [Listener at localhost/39659] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/mapreduce.cluster.local.dir/1675796584033/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 19:03:04,119 WARN [Listener at localhost/39659] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/mapreduce.cluster.local.dir/1675796584033/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 19:03:04,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,264 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,267 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,269 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:04,270 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1 2023-02-07 19:03:04,271 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61486df234f2a47482b972d415e6e0bd columnFamilyName f1 2023-02-07 19:03:04,278 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/testWithMapReduce=61486df234f2a47482b972d415e6e0bd-9ffa7b8ffe98409c904deeabbc940009 2023-02-07 19:03:04,279 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(310): Store=61486df234f2a47482b972d415e6e0bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,279 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:04,280 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2 2023-02-07 19:03:04,280 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61486df234f2a47482b972d415e6e0bd columnFamilyName f2 2023-02-07 19:03:04,286 DEBUG [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/testWithMapReduce=61486df234f2a47482b972d415e6e0bd-696efd2cb2124777b3d1ce85c812b019 2023-02-07 19:03:04,286 INFO [StoreOpener-61486df234f2a47482b972d415e6e0bd-1] regionserver.HStore(310): Store=61486df234f2a47482b972d415e6e0bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,287 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 61486df234f2a47482b972d415e6e0bd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61515061, jitterRate=-0.0833541601896286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 61486df234f2a47482b972d415e6e0bd: Writing region info on filesystem at 1675796584267Initializing all the Stores at 1675796584268 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584268Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584268Region opened successfully at 1675796584287 (+19 ms) 2023-02-07 19:03:04,436 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 61486df234f2a47482b972d415e6e0bd, disabling compactions & flushes 2023-02-07 19:03:04,436 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:04,436 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:04,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. after waiting 0 ms 2023-02-07 19:03:04,437 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:04,442 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:04,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 61486df234f2a47482b972d415e6e0bd: Waiting for close lock at 1675796584436Disabling compacts and flushes for region at 1675796584436Disabling writes for close at 1675796584437 (+1 ms)Writing region close event to WAL at 1675796584442 (+5 ms)Closed at 1675796584442 2023-02-07 19:03:04,457 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,458 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,462 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,464 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:04,466 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1 2023-02-07 19:03:04,466 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2359dcea29fa95d230fbc0e4ee1168b7 columnFamilyName f1 2023-02-07 19:03:04,475 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/testWithMapReduce=2359dcea29fa95d230fbc0e4ee1168b7-d2549a0f9ed84df39e2b6689d6d694f6 2023-02-07 19:03:04,475 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(310): Store=2359dcea29fa95d230fbc0e4ee1168b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,475 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:04,476 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2 2023-02-07 19:03:04,477 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2359dcea29fa95d230fbc0e4ee1168b7 columnFamilyName f2 2023-02-07 19:03:04,483 DEBUG [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/testWithMapReduce=2359dcea29fa95d230fbc0e4ee1168b7-3b2c5d84486349e4ae01d6af76ae9b9f 2023-02-07 19:03:04,484 INFO [StoreOpener-2359dcea29fa95d230fbc0e4ee1168b7-1] regionserver.HStore(310): Store=2359dcea29fa95d230fbc0e4ee1168b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,484 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2359dcea29fa95d230fbc0e4ee1168b7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62830700, jitterRate=-0.06374961137771606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2359dcea29fa95d230fbc0e4ee1168b7: Writing region info on filesystem at 1675796584462Initializing all the Stores at 1675796584464 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584464Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584464Region opened successfully at 1675796584485 (+21 ms) 2023-02-07 19:03:04,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2359dcea29fa95d230fbc0e4ee1168b7, disabling compactions & flushes 2023-02-07 19:03:04,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:04,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:04,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. after waiting 0 ms 2023-02-07 19:03:04,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:04,529 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:04,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2359dcea29fa95d230fbc0e4ee1168b7: Waiting for close lock at 1675796584526Disabling compacts and flushes for region at 1675796584526Disabling writes for close at 1675796584526Writing region close event to WAL at 1675796584529 (+3 ms)Closed at 1675796584529 2023-02-07 19:03:04,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,536 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,539 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,541 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:04,543 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1 2023-02-07 19:03:04,543 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f5c43a26bd48348e32e6c0a6784f9bc columnFamilyName f1 2023-02-07 19:03:04,551 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/testWithMapReduce=3f5c43a26bd48348e32e6c0a6784f9bc-99daf7905099401bb3418a1b671eff2e 2023-02-07 19:03:04,551 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(310): Store=3f5c43a26bd48348e32e6c0a6784f9bc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,551 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:04,552 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2 2023-02-07 19:03:04,552 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f5c43a26bd48348e32e6c0a6784f9bc columnFamilyName f2 2023-02-07 19:03:04,561 DEBUG [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/testWithMapReduce=3f5c43a26bd48348e32e6c0a6784f9bc-07ad5e9b1b4842d7b9c71adc04e89a89 2023-02-07 19:03:04,561 INFO [StoreOpener-3f5c43a26bd48348e32e6c0a6784f9bc-1] regionserver.HStore(310): Store=3f5c43a26bd48348e32e6c0a6784f9bc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,561 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,562 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3f5c43a26bd48348e32e6c0a6784f9bc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71846061, jitterRate=0.07058973610401154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3f5c43a26bd48348e32e6c0a6784f9bc: Writing region info on filesystem at 1675796584539Initializing all the Stores at 1675796584541 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584541Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584541Region opened successfully at 1675796584562 (+21 ms) 2023-02-07 19:03:04,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3f5c43a26bd48348e32e6c0a6784f9bc, disabling compactions & flushes 2023-02-07 19:03:04,608 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:04,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:04,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. after waiting 0 ms 2023-02-07 19:03:04,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:04,611 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:04,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3f5c43a26bd48348e32e6c0a6784f9bc: Waiting for close lock at 1675796584608Disabling compacts and flushes for region at 1675796584608Disabling writes for close at 1675796584608Writing region close event to WAL at 1675796584611 (+3 ms)Closed at 1675796584611 2023-02-07 19:03:04,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,615 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,619 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,621 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:04,622 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1 2023-02-07 19:03:04,623 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99fa7a707c08f867ed590c773e5e4af7 columnFamilyName f1 2023-02-07 19:03:04,629 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/testWithMapReduce=99fa7a707c08f867ed590c773e5e4af7-df571cbee04a4fca9acf7d802b0fb5a9 2023-02-07 19:03:04,629 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(310): Store=99fa7a707c08f867ed590c773e5e4af7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,629 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:04,630 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2 2023-02-07 19:03:04,631 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99fa7a707c08f867ed590c773e5e4af7 columnFamilyName f2 2023-02-07 19:03:04,638 DEBUG [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/testWithMapReduce=99fa7a707c08f867ed590c773e5e4af7-3b282054af494fd783a256ac9235d761 2023-02-07 19:03:04,638 INFO [StoreOpener-99fa7a707c08f867ed590c773e5e4af7-1] regionserver.HStore(310): Store=99fa7a707c08f867ed590c773e5e4af7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,638 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,638 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 99fa7a707c08f867ed590c773e5e4af7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62632849, jitterRate=-0.06669782102108002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,638 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 99fa7a707c08f867ed590c773e5e4af7: Writing region info on filesystem at 1675796584619Initializing all the Stores at 1675796584620 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584620Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584620Region opened successfully at 1675796584638 (+18 ms) 2023-02-07 19:03:04,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 99fa7a707c08f867ed590c773e5e4af7, disabling compactions & flushes 2023-02-07 19:03:04,755 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:04,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:04,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. after waiting 0 ms 2023-02-07 19:03:04,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:04,761 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:04,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 99fa7a707c08f867ed590c773e5e4af7: Waiting for close lock at 1675796584755Disabling compacts and flushes for region at 1675796584755Disabling writes for close at 1675796584755Writing region close event to WAL at 1675796584761 (+6 ms)Closed at 1675796584761 2023-02-07 19:03:04,766 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,767 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,771 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,774 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:04,776 DEBUG [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f1 2023-02-07 19:03:04,776 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46d15b5564040f0b4eea5b4129443c80 columnFamilyName f1 2023-02-07 19:03:04,777 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(310): Store=46d15b5564040f0b4eea5b4129443c80/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,777 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:04,779 DEBUG [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f2 2023-02-07 19:03:04,779 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46d15b5564040f0b4eea5b4129443c80 columnFamilyName f2 2023-02-07 19:03:04,780 INFO [StoreOpener-46d15b5564040f0b4eea5b4129443c80-1] regionserver.HStore(310): Store=46d15b5564040f0b4eea5b4129443c80/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,780 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 46d15b5564040f0b4eea5b4129443c80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66072127, jitterRate=-0.015448585152626038}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 46d15b5564040f0b4eea5b4129443c80: Writing region info on filesystem at 1675796584771Initializing all the Stores at 1675796584773 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584773Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584773Region opened successfully at 1675796584780 (+7 ms) 2023-02-07 19:03:04,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 46d15b5564040f0b4eea5b4129443c80, disabling compactions & flushes 2023-02-07 19:03:04,798 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:04,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:04,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. after waiting 0 ms 2023-02-07 19:03:04,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:04,799 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:04,799 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 46d15b5564040f0b4eea5b4129443c80: Waiting for close lock at 1675796584798Disabling compacts and flushes for region at 1675796584798Disabling writes for close at 1675796584798Writing region close event to WAL at 1675796584799 (+1 ms)Closed at 1675796584799 2023-02-07 19:03:04,805 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,805 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,806 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,808 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:04,809 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1 2023-02-07 19:03:04,810 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9373da399ebea705ef68b02e1da07aff columnFamilyName f1 2023-02-07 19:03:04,816 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/testWithMapReduce=9373da399ebea705ef68b02e1da07aff-96b1b2c7354b41a4b8eac7e7540341fa 2023-02-07 19:03:04,816 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(310): Store=9373da399ebea705ef68b02e1da07aff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,816 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:04,817 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2 2023-02-07 19:03:04,817 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9373da399ebea705ef68b02e1da07aff columnFamilyName f2 2023-02-07 19:03:04,823 DEBUG [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/testWithMapReduce=9373da399ebea705ef68b02e1da07aff-2091b128a4844b02a156110b854f6517 2023-02-07 19:03:04,823 INFO [StoreOpener-9373da399ebea705ef68b02e1da07aff-1] regionserver.HStore(310): Store=9373da399ebea705ef68b02e1da07aff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,823 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9373da399ebea705ef68b02e1da07aff; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65282435, jitterRate=-0.02721591293811798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9373da399ebea705ef68b02e1da07aff: Writing region info on filesystem at 1675796584806Initializing all the Stores at 1675796584807 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584807Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584807Region opened successfully at 1675796584823 (+16 ms) 2023-02-07 19:03:04,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9373da399ebea705ef68b02e1da07aff, disabling compactions & flushes 2023-02-07 19:03:04,853 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:04,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:04,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. after waiting 0 ms 2023-02-07 19:03:04,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:04,857 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:04,857 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9373da399ebea705ef68b02e1da07aff: Waiting for close lock at 1675796584853Disabling compacts and flushes for region at 1675796584853Disabling writes for close at 1675796584853Writing region close event to WAL at 1675796584857 (+4 ms)Closed at 1675796584857 2023-02-07 19:03:04,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,861 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,864 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,866 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:04,867 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1 2023-02-07 19:03:04,868 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f338c6378a72d9f763afd7ba0b32438f columnFamilyName f1 2023-02-07 19:03:04,875 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/testWithMapReduce=f338c6378a72d9f763afd7ba0b32438f-a709cfbf7e6a4ba5ae5d954e57fdd25d 2023-02-07 19:03:04,875 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(310): Store=f338c6378a72d9f763afd7ba0b32438f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,875 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:04,876 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2 2023-02-07 19:03:04,877 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f338c6378a72d9f763afd7ba0b32438f columnFamilyName f2 2023-02-07 19:03:04,883 DEBUG [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/testWithMapReduce=f338c6378a72d9f763afd7ba0b32438f-e471ce04c212441ab27dfa1af23eecd2 2023-02-07 19:03:04,884 INFO [StoreOpener-f338c6378a72d9f763afd7ba0b32438f-1] regionserver.HStore(310): Store=f338c6378a72d9f763afd7ba0b32438f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,884 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f338c6378a72d9f763afd7ba0b32438f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74909292, jitterRate=0.11623543500900269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f338c6378a72d9f763afd7ba0b32438f: Writing region info on filesystem at 1675796584864Initializing all the Stores at 1675796584865 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584865Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584866 (+1 ms)Region opened successfully at 1675796584884 (+18 ms) 2023-02-07 19:03:04,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f338c6378a72d9f763afd7ba0b32438f, disabling compactions & flushes 2023-02-07 19:03:04,912 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:04,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:04,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. after waiting 0 ms 2023-02-07 19:03:04,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:04,917 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:04,917 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f338c6378a72d9f763afd7ba0b32438f: Waiting for close lock at 1675796584912Disabling compacts and flushes for region at 1675796584912Disabling writes for close at 1675796584912Writing region close event to WAL at 1675796584917 (+5 ms)Closed at 1675796584917 2023-02-07 19:03:04,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,920 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,921 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,924 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:04,925 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1 2023-02-07 19:03:04,926 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6986e39a4f96e5d8aa8f6416d3d9a2c6 columnFamilyName f1 2023-02-07 19:03:04,932 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/testWithMapReduce=6986e39a4f96e5d8aa8f6416d3d9a2c6-b76f9d164fe343029d31e15c3b9cad88 2023-02-07 19:03:04,932 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(310): Store=6986e39a4f96e5d8aa8f6416d3d9a2c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,932 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:04,933 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2 2023-02-07 19:03:04,933 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6986e39a4f96e5d8aa8f6416d3d9a2c6 columnFamilyName f2 2023-02-07 19:03:04,939 DEBUG [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/testWithMapReduce=6986e39a4f96e5d8aa8f6416d3d9a2c6-1a79fc01f51542bfb73a5b4a390b9748 2023-02-07 19:03:04,939 INFO [StoreOpener-6986e39a4f96e5d8aa8f6416d3d9a2c6-1] regionserver.HStore(310): Store=6986e39a4f96e5d8aa8f6416d3d9a2c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:04,939 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6986e39a4f96e5d8aa8f6416d3d9a2c6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72414207, jitterRate=0.0790557712316513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:04,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: Writing region info on filesystem at 1675796584921Initializing all the Stores at 1675796584922 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584922Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584924 (+2 ms)Region opened successfully at 1675796584939 (+15 ms) 2023-02-07 19:03:04,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6986e39a4f96e5d8aa8f6416d3d9a2c6, disabling compactions & flushes 2023-02-07 19:03:04,977 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:04,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:04,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. after waiting 0 ms 2023-02-07 19:03:04,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:04,980 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:04,980 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: Waiting for close lock at 1675796584977Disabling compacts and flushes for region at 1675796584977Disabling writes for close at 1675796584977Writing region close event to WAL at 1675796584980 (+3 ms)Closed at 1675796584980 2023-02-07 19:03:04,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:04,984 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:04,986 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:04,988 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:04,989 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1 2023-02-07 19:03:04,989 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf4ed18d3fe4cb6be11a1bb525169fa1 columnFamilyName f1 2023-02-07 19:03:04,994 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/testWithMapReduce=bf4ed18d3fe4cb6be11a1bb525169fa1-ec9bce8274854790b586781cb6fda696 2023-02-07 19:03:04,994 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(310): Store=bf4ed18d3fe4cb6be11a1bb525169fa1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:04,995 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:04,995 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2 2023-02-07 19:03:04,996 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf4ed18d3fe4cb6be11a1bb525169fa1 columnFamilyName f2 2023-02-07 19:03:05,000 DEBUG [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(539): loaded hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/testWithMapReduce=bf4ed18d3fe4cb6be11a1bb525169fa1-c1aa667d7ab84e61a19ed9233033cd79 2023-02-07 19:03:05,001 INFO [StoreOpener-bf4ed18d3fe4cb6be11a1bb525169fa1-1] regionserver.HStore(310): Store=bf4ed18d3fe4cb6be11a1bb525169fa1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:05,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:05,001 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bf4ed18d3fe4cb6be11a1bb525169fa1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63180929, jitterRate=-0.058530792593955994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:05,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bf4ed18d3fe4cb6be11a1bb525169fa1: Writing region info on filesystem at 1675796584986Initializing all the Stores at 1675796584987 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584987Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796584987Region opened successfully at 1675796585001 (+14 ms) 2023-02-07 19:03:05,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bf4ed18d3fe4cb6be11a1bb525169fa1, disabling compactions & flushes 2023-02-07 19:03:05,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:05,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:05,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. after waiting 0 ms 2023-02-07 19:03:05,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:05,056 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:05,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bf4ed18d3fe4cb6be11a1bb525169fa1: Waiting for close lock at 1675796585054Disabling compacts and flushes for region at 1675796585054Disabling writes for close at 1675796585054Writing region close event to WAL at 1675796585056 (+2 ms)Closed at 1675796585056 2023-02-07 19:03:05,060 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:05,061 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:05,061 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:05,063 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:05,065 DEBUG [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f1 2023-02-07 19:03:05,065 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a077eee5fcca3c0df2ac9b6ea1b7e5ce columnFamilyName f1 2023-02-07 19:03:05,066 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(310): Store=a077eee5fcca3c0df2ac9b6ea1b7e5ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:05,066 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:05,068 DEBUG [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46511/user/jenkins/test-data/f3fa0c6d-dcdc-0bf1-bde1-bfa9a87e285d/testWithMapReduceMultiRegion/e1db5192-48e4-410f-ad8c-74572c3f1e09/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f2 2023-02-07 19:03:05,068 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a077eee5fcca3c0df2ac9b6ea1b7e5ce columnFamilyName f2 2023-02-07 19:03:05,069 INFO [StoreOpener-a077eee5fcca3c0df2ac9b6ea1b7e5ce-1] regionserver.HStore(310): Store=a077eee5fcca3c0df2ac9b6ea1b7e5ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:05,069 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:05,069 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a077eee5fcca3c0df2ac9b6ea1b7e5ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72031910, jitterRate=0.07335910201072693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:05,069 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: Writing region info on filesystem at 1675796585062Initializing all the Stores at 1675796585062Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796585062Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796585063 (+1 ms)Region opened successfully at 1675796585069 (+6 ms) 2023-02-07 19:03:05,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a077eee5fcca3c0df2ac9b6ea1b7e5ce, disabling compactions & flushes 2023-02-07 19:03:05,086 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:05,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:05,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. after waiting 0 ms 2023-02-07 19:03:05,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:05,087 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:05,087 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: Waiting for close lock at 1675796585086Disabling compacts and flushes for region at 1675796585086Disabling writes for close at 1675796585086Writing region close event to WAL at 1675796585087 (+1 ms)Closed at 1675796585087 2023-02-07 19:03:06,208 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,208 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMapReduceMultiRegion" 2023-02-07 19:03:06,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-07 19:03:06,220 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,220 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,221 INFO [Listener at localhost/39659] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 19:03:06,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-07 19:03:06,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-07 19:03:06,234 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796586234"}]},"ts":"1675796586234"} 2023-02-07 19:03:06,235 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,235 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:06,236 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-07 19:03:06,239 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-07 19:03:06,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, UNASSIGN}] 2023-02-07 19:03:06,246 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, UNASSIGN 2023-02-07 19:03:06,247 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2359dcea29fa95d230fbc0e4ee1168b7, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:06,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586247"}]},"ts":"1675796586247"} 2023-02-07 19:03:06,250 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, UNASSIGN 2023-02-07 19:03:06,250 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, UNASSIGN 2023-02-07 19:03:06,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure 2359dcea29fa95d230fbc0e4ee1168b7, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:03:06,250 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, UNASSIGN 2023-02-07 19:03:06,251 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, UNASSIGN 2023-02-07 19:03:06,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f338c6378a72d9f763afd7ba0b32438f, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:06,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586252"}]},"ts":"1675796586252"} 2023-02-07 19:03:06,252 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=99fa7a707c08f867ed590c773e5e4af7, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:06,253 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586252"}]},"ts":"1675796586252"} 2023-02-07 19:03:06,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=bf4ed18d3fe4cb6be11a1bb525169fa1, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:06,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586254"}]},"ts":"1675796586254"} 2023-02-07 19:03:06,255 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a077eee5fcca3c0df2ac9b6ea1b7e5ce, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:06,255 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796586255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586255"}]},"ts":"1675796586255"} 2023-02-07 19:03:06,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure f338c6378a72d9f763afd7ba0b32438f, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:03:06,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 99fa7a707c08f867ed590c773e5e4af7, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:03:06,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=36, state=RUNNABLE; CloseRegionProcedure bf4ed18d3fe4cb6be11a1bb525169fa1, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:03:06,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure a077eee5fcca3c0df2ac9b6ea1b7e5ce, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:03:06,261 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, UNASSIGN 2023-02-07 19:03:06,263 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6986e39a4f96e5d8aa8f6416d3d9a2c6, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:06,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, UNASSIGN 2023-02-07 19:03:06,263 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586263"}]},"ts":"1675796586263"} 2023-02-07 19:03:06,264 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, UNASSIGN 2023-02-07 19:03:06,264 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, UNASSIGN 2023-02-07 19:03:06,265 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, UNASSIGN 2023-02-07 19:03:06,266 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9373da399ebea705ef68b02e1da07aff, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:06,266 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586266"}]},"ts":"1675796586266"} 2023-02-07 19:03:06,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 6986e39a4f96e5d8aa8f6416d3d9a2c6, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:03:06,266 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=3f5c43a26bd48348e32e6c0a6784f9bc, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:06,266 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586266"}]},"ts":"1675796586266"} 2023-02-07 19:03:06,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=61486df234f2a47482b972d415e6e0bd, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:06,267 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586266"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586266"}]},"ts":"1675796586266"} 2023-02-07 19:03:06,267 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=46d15b5564040f0b4eea5b4129443c80, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:06,268 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796586267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796586267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796586267"}]},"ts":"1675796586267"} 2023-02-07 19:03:06,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure 9373da399ebea705ef68b02e1da07aff, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:03:06,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure 3f5c43a26bd48348e32e6c0a6784f9bc, server=jenkins-hbase6.apache.org,37771,1675796574811}] 2023-02-07 19:03:06,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=41, state=RUNNABLE; CloseRegionProcedure 61486df234f2a47482b972d415e6e0bd, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:03:06,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 46d15b5564040f0b4eea5b4129443c80, server=jenkins-hbase6.apache.org,39131,1675796574866}] 2023-02-07 19:03:06,336 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,337 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:06,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 9373da399ebea705ef68b02e1da07aff, disabling compactions & flushes 2023-02-07 19:03:06,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. after waiting 0 ms 2023-02-07 19:03:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:06,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing f338c6378a72d9f763afd7ba0b32438f, disabling compactions & flushes 2023-02-07 19:03:06,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. after waiting 0 ms 2023-02-07 19:03:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:06,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff. 2023-02-07 19:03:06,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 9373da399ebea705ef68b02e1da07aff: Waiting for close lock at 1675796586415Running coprocessor pre-close hooks at 1675796586415Disabling compacts and flushes for region at 1675796586415Disabling writes for close at 1675796586415Writing region close event to WAL at 1675796586427 (+12 ms)Running coprocessor post-close hooks at 1675796586439 (+12 ms)Closed at 1675796586440 (+1 ms) 2023-02-07 19:03:06,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f. 2023-02-07 19:03:06,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for f338c6378a72d9f763afd7ba0b32438f: Waiting for close lock at 1675796586416Running coprocessor pre-close hooks at 1675796586416Disabling compacts and flushes for region at 1675796586416Disabling writes for close at 1675796586416Writing region close event to WAL at 1675796586429 (+13 ms)Running coprocessor post-close hooks at 1675796586440 (+11 ms)Closed at 1675796586441 (+1 ms) 2023-02-07 19:03:06,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:06,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:06,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 6986e39a4f96e5d8aa8f6416d3d9a2c6, disabling compactions & flushes 2023-02-07 19:03:06,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:06,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:06,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. after waiting 0 ms 2023-02-07 19:03:06,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:06,444 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f338c6378a72d9f763afd7ba0b32438f, regionState=CLOSED 2023-02-07 19:03:06,444 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586444"}]},"ts":"1675796586444"} 2023-02-07 19:03:06,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:06,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:06,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 99fa7a707c08f867ed590c773e5e4af7, disabling compactions & flushes 2023-02-07 19:03:06,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:06,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:06,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. after waiting 0 ms 2023-02-07 19:03:06,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:06,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9373da399ebea705ef68b02e1da07aff, regionState=CLOSED 2023-02-07 19:03:06,445 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586445"}]},"ts":"1675796586445"} 2023-02-07 19:03:06,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-07 19:03:06,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure f338c6378a72d9f763afd7ba0b32438f, server=jenkins-hbase6.apache.org,39131,1675796574866 in 194 msec 2023-02-07 19:03:06,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-07 19:03:06,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure 9373da399ebea705ef68b02e1da07aff, server=jenkins-hbase6.apache.org,37771,1675796574811 in 184 msec 2023-02-07 19:03:06,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f338c6378a72d9f763afd7ba0b32438f, UNASSIGN in 214 msec 2023-02-07 19:03:06,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9373da399ebea705ef68b02e1da07aff, UNASSIGN in 214 msec 2023-02-07 19:03:06,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6. 2023-02-07 19:03:06,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 6986e39a4f96e5d8aa8f6416d3d9a2c6: Waiting for close lock at 1675796586443Running coprocessor pre-close hooks at 1675796586443Disabling compacts and flushes for region at 1675796586443Disabling writes for close at 1675796586444 (+1 ms)Writing region close event to WAL at 1675796586465 (+21 ms)Running coprocessor post-close hooks at 1675796586477 (+12 ms)Closed at 1675796586478 (+1 ms) 2023-02-07 19:03:06,487 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6986e39a4f96e5d8aa8f6416d3d9a2c6, regionState=CLOSED 2023-02-07 19:03:06,487 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586487"}]},"ts":"1675796586487"} 2023-02-07 19:03:06,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:06,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:06,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing bf4ed18d3fe4cb6be11a1bb525169fa1, disabling compactions & flushes 2023-02-07 19:03:06,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:06,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:06,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. after waiting 0 ms 2023-02-07 19:03:06,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:06,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-07 19:03:06,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 6986e39a4f96e5d8aa8f6416d3d9a2c6, server=jenkins-hbase6.apache.org,39131,1675796574866 in 224 msec 2023-02-07 19:03:06,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6986e39a4f96e5d8aa8f6416d3d9a2c6, UNASSIGN in 250 msec 2023-02-07 19:03:06,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7. 2023-02-07 19:03:06,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 99fa7a707c08f867ed590c773e5e4af7: Waiting for close lock at 1675796586445Running coprocessor pre-close hooks at 1675796586445Disabling compacts and flushes for region at 1675796586445Disabling writes for close at 1675796586445Writing region close event to WAL at 1675796586478 (+33 ms)Running coprocessor post-close hooks at 1675796586505 (+27 ms)Closed at 1675796586505 2023-02-07 19:03:06,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:06,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:06,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 2359dcea29fa95d230fbc0e4ee1168b7, disabling compactions & flushes 2023-02-07 19:03:06,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:06,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:06,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. after waiting 0 ms 2023-02-07 19:03:06,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:06,509 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=99fa7a707c08f867ed590c773e5e4af7, regionState=CLOSED 2023-02-07 19:03:06,509 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586509"}]},"ts":"1675796586509"} 2023-02-07 19:03:06,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-07 19:03:06,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 99fa7a707c08f867ed590c773e5e4af7, server=jenkins-hbase6.apache.org,37771,1675796574811 in 254 msec 2023-02-07 19:03:06,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=99fa7a707c08f867ed590c773e5e4af7, UNASSIGN in 273 msec 2023-02-07 19:03:06,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1. 2023-02-07 19:03:06,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for bf4ed18d3fe4cb6be11a1bb525169fa1: Waiting for close lock at 1675796586488Running coprocessor pre-close hooks at 1675796586488Disabling compacts and flushes for region at 1675796586488Disabling writes for close at 1675796586488Writing region close event to WAL at 1675796586520 (+32 ms)Running coprocessor post-close hooks at 1675796586526 (+6 ms)Closed at 1675796586527 (+1 ms) 2023-02-07 19:03:06,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7. 2023-02-07 19:03:06,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 2359dcea29fa95d230fbc0e4ee1168b7: Waiting for close lock at 1675796586508Running coprocessor pre-close hooks at 1675796586508Disabling compacts and flushes for region at 1675796586508Disabling writes for close at 1675796586508Writing region close event to WAL at 1675796586522 (+14 ms)Running coprocessor post-close hooks at 1675796586527 (+5 ms)Closed at 1675796586528 (+1 ms) 2023-02-07 19:03:06,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:06,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:06,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 61486df234f2a47482b972d415e6e0bd, disabling compactions & flushes 2023-02-07 19:03:06,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:06,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:06,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. after waiting 0 ms 2023-02-07 19:03:06,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:06,530 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=bf4ed18d3fe4cb6be11a1bb525169fa1, regionState=CLOSED 2023-02-07 19:03:06,531 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586530"}]},"ts":"1675796586530"} 2023-02-07 19:03:06,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:06,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:06,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 3f5c43a26bd48348e32e6c0a6784f9bc, disabling compactions & flushes 2023-02-07 19:03:06,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:06,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:06,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. after waiting 0 ms 2023-02-07 19:03:06,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:06,531 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2359dcea29fa95d230fbc0e4ee1168b7, regionState=CLOSED 2023-02-07 19:03:06,531 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586531"}]},"ts":"1675796586531"} 2023-02-07 19:03:06,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=36 2023-02-07 19:03:06,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=36, state=SUCCESS; CloseRegionProcedure bf4ed18d3fe4cb6be11a1bb525169fa1, server=jenkins-hbase6.apache.org,39131,1675796574866 in 275 msec 2023-02-07 19:03:06,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-07 19:03:06,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure 2359dcea29fa95d230fbc0e4ee1168b7, server=jenkins-hbase6.apache.org,37771,1675796574811 in 284 msec 2023-02-07 19:03:06,539 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,539 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bf4ed18d3fe4cb6be11a1bb525169fa1, UNASSIGN in 295 msec 2023-02-07 19:03:06,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:06,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2359dcea29fa95d230fbc0e4ee1168b7, UNASSIGN in 297 msec 2023-02-07 19:03:06,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:06,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc. 2023-02-07 19:03:06,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 3f5c43a26bd48348e32e6c0a6784f9bc: Waiting for close lock at 1675796586531Running coprocessor pre-close hooks at 1675796586531Disabling compacts and flushes for region at 1675796586531Disabling writes for close at 1675796586531Writing region close event to WAL at 1675796586541 (+10 ms)Running coprocessor post-close hooks at 1675796586546 (+5 ms)Closed at 1675796586547 (+1 ms) 2023-02-07 19:03:06,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd. 2023-02-07 19:03:06,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 61486df234f2a47482b972d415e6e0bd: Waiting for close lock at 1675796586530Running coprocessor pre-close hooks at 1675796586530Disabling compacts and flushes for region at 1675796586530Disabling writes for close at 1675796586530Writing region close event to WAL at 1675796586540 (+10 ms)Running coprocessor post-close hooks at 1675796586548 (+8 ms)Closed at 1675796586550 (+2 ms) 2023-02-07 19:03:06,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:06,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:06,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing a077eee5fcca3c0df2ac9b6ea1b7e5ce, disabling compactions & flushes 2023-02-07 19:03:06,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:06,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:06,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. after waiting 0 ms 2023-02-07 19:03:06,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:06,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=3f5c43a26bd48348e32e6c0a6784f9bc, regionState=CLOSED 2023-02-07 19:03:06,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586551"}]},"ts":"1675796586551"} 2023-02-07 19:03:06,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:06,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:06,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 46d15b5564040f0b4eea5b4129443c80, disabling compactions & flushes 2023-02-07 19:03:06,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:06,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:06,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. after waiting 0 ms 2023-02-07 19:03:06,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:06,555 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=61486df234f2a47482b972d415e6e0bd, regionState=CLOSED 2023-02-07 19:03:06,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796586555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586555"}]},"ts":"1675796586555"} 2023-02-07 19:03:06,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-07 19:03:06,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure 3f5c43a26bd48348e32e6c0a6784f9bc, server=jenkins-hbase6.apache.org,37771,1675796574811 in 284 msec 2023-02-07 19:03:06,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=41 2023-02-07 19:03:06,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3f5c43a26bd48348e32e6c0a6784f9bc, UNASSIGN in 322 msec 2023-02-07 19:03:06,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=41, state=SUCCESS; CloseRegionProcedure 61486df234f2a47482b972d415e6e0bd, server=jenkins-hbase6.apache.org,39131,1675796574866 in 286 msec 2023-02-07 19:03:06,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=61486df234f2a47482b972d415e6e0bd, UNASSIGN in 324 msec 2023-02-07 19:03:06,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 19:03:06,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 19:03:06,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80. 2023-02-07 19:03:06,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 46d15b5564040f0b4eea5b4129443c80: Waiting for close lock at 1675796586553Running coprocessor pre-close hooks at 1675796586553Disabling compacts and flushes for region at 1675796586553Disabling writes for close at 1675796586554 (+1 ms)Writing region close event to WAL at 1675796586567 (+13 ms)Running coprocessor post-close hooks at 1675796586572 (+5 ms)Closed at 1675796586573 (+1 ms) 2023-02-07 19:03:06,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce. 2023-02-07 19:03:06,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for a077eee5fcca3c0df2ac9b6ea1b7e5ce: Waiting for close lock at 1675796586551Running coprocessor pre-close hooks at 1675796586551Disabling compacts and flushes for region at 1675796586551Disabling writes for close at 1675796586551Writing region close event to WAL at 1675796586566 (+15 ms)Running coprocessor post-close hooks at 1675796586573 (+7 ms)Closed at 1675796586575 (+2 ms) 2023-02-07 19:03:06,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:06,578 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=46d15b5564040f0b4eea5b4129443c80, regionState=CLOSED 2023-02-07 19:03:06,578 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796586578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586578"}]},"ts":"1675796586578"} 2023-02-07 19:03:06,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:06,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a077eee5fcca3c0df2ac9b6ea1b7e5ce, regionState=CLOSED 2023-02-07 19:03:06,579 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796586578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796586578"}]},"ts":"1675796586578"} 2023-02-07 19:03:06,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-07 19:03:06,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 46d15b5564040f0b4eea5b4129443c80, server=jenkins-hbase6.apache.org,39131,1675796574866 in 307 msec 2023-02-07 19:03:06,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-07 19:03:06,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure a077eee5fcca3c0df2ac9b6ea1b7e5ce, server=jenkins-hbase6.apache.org,37771,1675796574811 in 322 msec 2023-02-07 19:03:06,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=46d15b5564040f0b4eea5b4129443c80, UNASSIGN in 342 msec 2023-02-07 19:03:06,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-07 19:03:06,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a077eee5fcca3c0df2ac9b6ea1b7e5ce, UNASSIGN in 342 msec 2023-02-07 19:03:06,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796586588"}]},"ts":"1675796586588"} 2023-02-07 19:03:06,590 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-07 19:03:06,592 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-07 19:03:06,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 370 msec 2023-02-07 19:03:06,841 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,841 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:06,843 INFO [Listener at localhost/39659] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-07 19:03:06,844 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,844 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMapReduce 2023-02-07 19:03:06,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:06,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:06,860 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:06,860 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,860 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 19:03:06,875 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:06,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:06,875 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:06,876 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:06,875 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:06,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:06,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:06,875 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/recovered.edits] 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/recovered.edits] 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/recovered.edits] 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/recovered.edits] 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/recovered.edits] 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/recovered.edits] 2023-02-07 19:03:06,881 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/recovered.edits] 2023-02-07 19:03:06,882 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/recovered.edits] 2023-02-07 19:03:06,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/0ff5656c533745ff8a342d4da1861942 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/0ff5656c533745ff8a342d4da1861942 2023-02-07 19:03:06,894 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/70f6d32127424d36b3bf60950c6b3270 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/70f6d32127424d36b3bf60950c6b3270 2023-02-07 19:03:06,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/455b1ca1c6084f02a9114737311d661e to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/455b1ca1c6084f02a9114737311d661e 2023-02-07 19:03:06,894 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/72e811c736634d718fb585657715852d to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/72e811c736634d718fb585657715852d 2023-02-07 19:03:06,895 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/5bb4d4792cae4a5fa1223e76c5403437 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/5bb4d4792cae4a5fa1223e76c5403437 2023-02-07 19:03:06,895 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/9ffa7b8ffe98409c904deeabbc940009 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/9ffa7b8ffe98409c904deeabbc940009 2023-02-07 19:03:06,895 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/bbf6ba55390d4fc68d6bb3db3714517e to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/bbf6ba55390d4fc68d6bb3db3714517e 2023-02-07 19:03:06,897 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/recovered.edits/6.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80/recovered.edits/6.seqid 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/99daf7905099401bb3418a1b671eff2e to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f1/99daf7905099401bb3418a1b671eff2e 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/46d15b5564040f0b4eea5b4129443c80 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/ec9bce8274854790b586781cb6fda696 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f1/ec9bce8274854790b586781cb6fda696 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/d2549a0f9ed84df39e2b6689d6d694f6 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f1/d2549a0f9ed84df39e2b6689d6d694f6 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f1/a709cfbf7e6a4ba5ae5d954e57fdd25d 2023-02-07 19:03:06,899 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/df571cbee04a4fca9acf7d802b0fb5a9 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f1/df571cbee04a4fca9acf7d802b0fb5a9 2023-02-07 19:03:06,900 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/96b1b2c7354b41a4b8eac7e7540341fa to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f1/96b1b2c7354b41a4b8eac7e7540341fa 2023-02-07 19:03:06,900 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/dcc4c3327ec04a3f99bb57ade531a9ef to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f1/dcc4c3327ec04a3f99bb57ade531a9ef 2023-02-07 19:03:06,905 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/recovered.edits] 2023-02-07 19:03:06,908 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/c1aa667d7ab84e61a19ed9233033cd79 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/c1aa667d7ab84e61a19ed9233033cd79 2023-02-07 19:03:06,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/2091b128a4844b02a156110b854f6517 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/2091b128a4844b02a156110b854f6517 2023-02-07 19:03:06,909 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/07ad5e9b1b4842d7b9c71adc04e89a89 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/07ad5e9b1b4842d7b9c71adc04e89a89 2023-02-07 19:03:06,910 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/0622a67d56b540a48f692dbb6377fe54 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/0622a67d56b540a48f692dbb6377fe54 2023-02-07 19:03:06,911 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/3b282054af494fd783a256ac9235d761 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/3b282054af494fd783a256ac9235d761 2023-02-07 19:03:06,911 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/696efd2cb2124777b3d1ce85c812b019 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/696efd2cb2124777b3d1ce85c812b019 2023-02-07 19:03:06,911 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3ad5f5d9090e489ab3331d78c6324c8a to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3ad5f5d9090e489ab3331d78c6324c8a 2023-02-07 19:03:06,915 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/f853a4dc4c214063b771add12bc1c716 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/f2/f853a4dc4c214063b771add12bc1c716 2023-02-07 19:03:06,915 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/68c47e4447884a0fb60af49114131647 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/f2/68c47e4447884a0fb60af49114131647 2023-02-07 19:03:06,915 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/e471ce04c212441ab27dfa1af23eecd2 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/f2/e471ce04c212441ab27dfa1af23eecd2 2023-02-07 19:03:06,916 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/a37c6955567a4aa18bf07946a9c3a997 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/f2/a37c6955567a4aa18bf07946a9c3a997 2023-02-07 19:03:06,916 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/636061b34e5e476fa7640b8412927c4a to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/f2/636061b34e5e476fa7640b8412927c4a 2023-02-07 19:03:06,916 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/f6ed01a813f84186b0aea71a0188d53f to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/f2/f6ed01a813f84186b0aea71a0188d53f 2023-02-07 19:03:06,918 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3b2c5d84486349e4ae01d6af76ae9b9f to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/f2/3b2c5d84486349e4ae01d6af76ae9b9f 2023-02-07 19:03:06,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/7db8c5c5f2f2414e8a697683068c415c to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/7db8c5c5f2f2414e8a697683068c415c 2023-02-07 19:03:06,926 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1/recovered.edits/12.seqid 2023-02-07 19:03:06,926 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f/recovered.edits/12.seqid 2023-02-07 19:03:06,926 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff/recovered.edits/12.seqid 2023-02-07 19:03:06,926 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/b76f9d164fe343029d31e15c3b9cad88 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f1/b76f9d164fe343029d31e15c3b9cad88 2023-02-07 19:03:06,930 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc/recovered.edits/12.seqid 2023-02-07 19:03:06,939 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd/recovered.edits/12.seqid 2023-02-07 19:03:06,939 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/bf4ed18d3fe4cb6be11a1bb525169fa1 2023-02-07 19:03:06,940 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:06,940 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/f338c6378a72d9f763afd7ba0b32438f 2023-02-07 19:03:06,940 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/3f5c43a26bd48348e32e6c0a6784f9bc 2023-02-07 19:03:06,940 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/9373da399ebea705ef68b02e1da07aff 2023-02-07 19:03:06,940 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7/recovered.edits/12.seqid 2023-02-07 19:03:06,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/61486df234f2a47482b972d415e6e0bd 2023-02-07 19:03:06,941 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7/recovered.edits/12.seqid 2023-02-07 19:03:06,941 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/99fa7a707c08f867ed590c773e5e4af7 2023-02-07 19:03:06,941 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/2359dcea29fa95d230fbc0e4ee1168b7 2023-02-07 19:03:06,942 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f1, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/f2, FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/recovered.edits] 2023-02-07 19:03:06,943 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/1a79fc01f51542bfb73a5b4a390b9748 to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/1a79fc01f51542bfb73a5b4a390b9748 2023-02-07 19:03:06,945 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/d8c53070df8d4239b3d5f1c29ca78c7f to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/f2/d8c53070df8d4239b3d5f1c29ca78c7f 2023-02-07 19:03:06,948 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/recovered.edits/12.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6/recovered.edits/12.seqid 2023-02-07 19:03:06,948 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/recovered.edits/6.seqid to hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/archive/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce/recovered.edits/6.seqid 2023-02-07 19:03:06,949 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/6986e39a4f96e5d8aa8f6416d3d9a2c6 2023-02-07 19:03:06,949 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/.tmp/data/default/testWithMapReduce/a077eee5fcca3c0df2ac9b6ea1b7e5ce 2023-02-07 19:03:06,949 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 19:03:06,952 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:06,963 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:06,963 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:06,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 19:03:06,977 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-07 19:03:06,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-07 19:03:06,983 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:06,983 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-07 19:03:06,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796586983"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,993 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-07 19:03:06,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 46d15b5564040f0b4eea5b4129443c80, NAME => 'testWithMapReduce,,1675796577829.46d15b5564040f0b4eea5b4129443c80.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 3f5c43a26bd48348e32e6c0a6784f9bc, NAME => 'testWithMapReduce,aaa,1675796577829.3f5c43a26bd48348e32e6c0a6784f9bc.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => bf4ed18d3fe4cb6be11a1bb525169fa1, NAME => 'testWithMapReduce,d\x84\x84,1675796577829.bf4ed18d3fe4cb6be11a1bb525169fa1.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 99fa7a707c08f867ed590c773e5e4af7, NAME => 'testWithMapReduce,g\xA7\xA7,1675796577829.99fa7a707c08f867ed590c773e5e4af7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => f338c6378a72d9f763afd7ba0b32438f, NAME => 'testWithMapReduce,j\xCA\xCA,1675796577829.f338c6378a72d9f763afd7ba0b32438f.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2359dcea29fa95d230fbc0e4ee1168b7, NAME => 'testWithMapReduce,m\xED\xED,1675796577829.2359dcea29fa95d230fbc0e4ee1168b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9373da399ebea705ef68b02e1da07aff, NAME => 'testWithMapReduce,q\x11\x10,1675796577829.9373da399ebea705ef68b02e1da07aff.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 61486df234f2a47482b972d415e6e0bd, NAME => 'testWithMapReduce,t43,1675796577829.61486df234f2a47482b972d415e6e0bd.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 6986e39a4f96e5d8aa8f6416d3d9a2c6, NAME => 'testWithMapReduce,wWV,1675796577829.6986e39a4f96e5d8aa8f6416d3d9a2c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => a077eee5fcca3c0df2ac9b6ea1b7e5ce, NAME => 'testWithMapReduce,zz{,1675796577829.a077eee5fcca3c0df2ac9b6ea1b7e5ce.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-07 19:03:06,993 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-07 19:03:06,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675796586993"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:06,995 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-07 19:03:06,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:07,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 150 msec 2023-02-07 19:03:07,165 INFO [Listener at localhost/39659] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:07,165 INFO [Listener at localhost/39659] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:07,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 19:03:07,167 INFO [Listener at localhost/39659] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-07 19:03:07,167 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:07,167 INFO [Listener at localhost/39659] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:07,167 DEBUG [Listener at localhost/39659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24925f51 to 127.0.0.1:51055 2023-02-07 19:03:07,167 DEBUG [Listener at localhost/39659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,168 DEBUG [Listener at localhost/39659] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:07,168 DEBUG [Listener at localhost/39659] util.JVMClusterUtil(257): Found active master hash=1189863075, stopped=false 2023-02-07 19:03:07,168 INFO [Listener at localhost/39659] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:03:07,171 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:07,171 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:07,171 INFO [Listener at localhost/39659] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:07,171 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:07,171 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:07,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:07,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:07,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:07,173 DEBUG [Listener at localhost/39659] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46ecd70c to 127.0.0.1:51055 2023-02-07 19:03:07,173 DEBUG [Listener at localhost/39659] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,173 INFO [Listener at localhost/39659] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,37771,1675796574811' ***** 2023-02-07 19:03:07,173 INFO [Listener at localhost/39659] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:07,173 INFO [Listener at localhost/39659] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39131,1675796574866' ***** 2023-02-07 19:03:07,173 INFO [Listener at localhost/39659] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:07,173 INFO [RS:0;jenkins-hbase6:37771] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:07,173 INFO [RS:1;jenkins-hbase6:39131] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:07,174 INFO [RS:1;jenkins-hbase6:39131] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:07,174 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:07,174 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:07,174 INFO [RS:0;jenkins-hbase6:37771] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:07,174 INFO [RS:1;jenkins-hbase6:39131] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:07,175 INFO [RS:0;jenkins-hbase6:37771] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:07,175 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:07,175 DEBUG [RS:1;jenkins-hbase6:39131] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ace2ed6 to 127.0.0.1:51055 2023-02-07 19:03:07,175 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(3304): Received CLOSE for 12be8b6b9dc46ca60c25692a01e4fc7c 2023-02-07 19:03:07,175 DEBUG [RS:1;jenkins-hbase6:39131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,175 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39131,1675796574866; all regions closed. 2023-02-07 19:03:07,175 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:07,175 DEBUG [RS:0;jenkins-hbase6:37771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a8a985e to 127.0.0.1:51055 2023-02-07 19:03:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 12be8b6b9dc46ca60c25692a01e4fc7c, disabling compactions & flushes 2023-02-07 19:03:07,176 DEBUG [RS:0;jenkins-hbase6:37771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:03:07,176 INFO [RS:0;jenkins-hbase6:37771] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:03:07,176 INFO [RS:0;jenkins-hbase6:37771] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. after waiting 0 ms 2023-02-07 19:03:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:03:07,176 INFO [RS:0;jenkins-hbase6:37771] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 12be8b6b9dc46ca60c25692a01e4fc7c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:07,176 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:07,177 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-07 19:03:07,177 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1479): Online Regions={12be8b6b9dc46ca60c25692a01e4fc7c=hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c., 1588230740=hbase:meta,,1.1588230740} 2023-02-07 19:03:07,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:07,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:07,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:07,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:07,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:07,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-07 19:03:07,179 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1505): Waiting on 12be8b6b9dc46ca60c25692a01e4fc7c, 1588230740 2023-02-07 19:03:07,185 DEBUG [RS:1;jenkins-hbase6:39131] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/oldWALs 2023-02-07 19:03:07,185 INFO [RS:1;jenkins-hbase6:39131] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39131%2C1675796574866:(num 1675796577329) 2023-02-07 19:03:07,185 DEBUG [RS:1;jenkins-hbase6:39131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,185 INFO [RS:1;jenkins-hbase6:39131] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:07,185 INFO [RS:1;jenkins-hbase6:39131] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:07,185 INFO [RS:1;jenkins-hbase6:39131] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:07,185 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:07,186 INFO [RS:1;jenkins-hbase6:39131] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:07,186 INFO [RS:1;jenkins-hbase6:39131] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:07,187 INFO [RS:1;jenkins-hbase6:39131] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39131 2023-02-07 19:03:07,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/.tmp/info/75df6233a581498cbdf786346f1abd92 2023-02-07 19:03:07,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75df6233a581498cbdf786346f1abd92 2023-02-07 19:03:07,227 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:07,227 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:07,285 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:07,285 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:07,285 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39131,1675796574866 2023-02-07 19:03:07,285 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:07,285 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:07,285 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,39131,1675796574866] 2023-02-07 19:03:07,286 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,39131,1675796574866; numProcessing=1 2023-02-07 19:03:07,287 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,39131,1675796574866 already deleted, retry=false 2023-02-07 19:03:07,287 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,39131,1675796574866 expired; onlineServers=1 2023-02-07 19:03:07,311 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 19:03:07,312 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 19:03:07,379 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1505): Waiting on 12be8b6b9dc46ca60c25692a01e4fc7c, 1588230740 2023-02-07 19:03:07,572 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:07,572 INFO [RS:1;jenkins-hbase6:39131] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39131,1675796574866; zookeeper connection closed. 2023-02-07 19:03:07,572 ERROR [Listener at localhost/39659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@670d8668 rejected from java.util.concurrent.ThreadPoolExecutor@63321e51[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:07,572 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4253b1c3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4253b1c3 2023-02-07 19:03:07,572 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:39131-0x1013e979e660002, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:07,572 ERROR [Listener at localhost/39659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c6986c9 rejected from java.util.concurrent.ThreadPoolExecutor@63321e51[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:07,579 DEBUG [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1505): Waiting on 12be8b6b9dc46ca60c25692a01e4fc7c, 1588230740 2023-02-07 19:03:07,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/.tmp/info/e778597b7a30485a952d65da3e077b62 2023-02-07 19:03:07,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/.tmp/info/e778597b7a30485a952d65da3e077b62 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/info/e778597b7a30485a952d65da3e077b62 2023-02-07 19:03:07,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/info/e778597b7a30485a952d65da3e077b62, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:07,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 12be8b6b9dc46ca60c25692a01e4fc7c in 443ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:07,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/namespace/12be8b6b9dc46ca60c25692a01e4fc7c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:07,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:03:07,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 12be8b6b9dc46ca60c25692a01e4fc7c: Waiting for close lock at 1675796587175Running coprocessor pre-close hooks at 1675796587175Disabling compacts and flushes for region at 1675796587175Disabling writes for close at 1675796587176 (+1 ms)Obtaining lock to block concurrent updates at 1675796587176Preparing flush snapshotting stores in 12be8b6b9dc46ca60c25692a01e4fc7c at 1675796587176Finished memstore snapshotting hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796587177 (+1 ms)Flushing stores of hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. at 1675796587177Flushing 12be8b6b9dc46ca60c25692a01e4fc7c/info: creating writer at 1675796587178 (+1 ms)Flushing 12be8b6b9dc46ca60c25692a01e4fc7c/info: appending metadata at 1675796587182 (+4 ms)Flushing 12be8b6b9dc46ca60c25692a01e4fc7c/info: closing flushed file at 1675796587182Flushing 12be8b6b9dc46ca60c25692a01e4fc7c/info: reopening flushed file at 1675796587612 (+430 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 12be8b6b9dc46ca60c25692a01e4fc7c in 443ms, sequenceid=6, compaction requested=false at 1675796587619 (+7 ms)Writing region close event to WAL at 1675796587621 (+2 ms)Running coprocessor post-close hooks at 1675796587625 (+4 ms)Closed at 1675796587625 2023-02-07 19:03:07,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796576924.12be8b6b9dc46ca60c25692a01e4fc7c. 2023-02-07 19:03:07,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/.tmp/rep_barrier/ca05706096734ba59b78724784eafe00 2023-02-07 19:03:07,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca05706096734ba59b78724784eafe00 2023-02-07 19:03:07,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/.tmp/table/24e7a3ced10943118d9aef43c9346d7c 2023-02-07 19:03:07,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24e7a3ced10943118d9aef43c9346d7c 2023-02-07 19:03:07,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/.tmp/info/75df6233a581498cbdf786346f1abd92 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/info/75df6233a581498cbdf786346f1abd92 2023-02-07 19:03:07,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75df6233a581498cbdf786346f1abd92 2023-02-07 19:03:07,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/info/75df6233a581498cbdf786346f1abd92, entries=30, sequenceid=57, filesize=7.9 K 2023-02-07 19:03:07,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/.tmp/rep_barrier/ca05706096734ba59b78724784eafe00 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/rep_barrier/ca05706096734ba59b78724784eafe00 2023-02-07 19:03:07,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca05706096734ba59b78724784eafe00 2023-02-07 19:03:07,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/rep_barrier/ca05706096734ba59b78724784eafe00, entries=10, sequenceid=57, filesize=5.9 K 2023-02-07 19:03:07,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/.tmp/table/24e7a3ced10943118d9aef43c9346d7c as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/table/24e7a3ced10943118d9aef43c9346d7c 2023-02-07 19:03:07,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24e7a3ced10943118d9aef43c9346d7c 2023-02-07 19:03:07,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/table/24e7a3ced10943118d9aef43c9346d7c, entries=13, sequenceid=57, filesize=5.9 K 2023-02-07 19:03:07,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 496ms, sequenceid=57, compaction requested=false 2023-02-07 19:03:07,680 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-07 19:03:07,681 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:07,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:07,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796587177Running coprocessor pre-close hooks at 1675796587177Disabling compacts and flushes for region at 1675796587177Disabling writes for close at 1675796587177Obtaining lock to block concurrent updates at 1675796587178 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675796587178Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675796587178Flushing stores of hbase:meta,,1.1588230740 at 1675796587178Flushing 1588230740/info: creating writer at 1675796587179 (+1 ms)Flushing 1588230740/info: appending metadata at 1675796587185 (+6 ms)Flushing 1588230740/info: closing flushed file at 1675796587186 (+1 ms)Flushing 1588230740/rep_barrier: creating writer at 1675796587218 (+32 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675796587221 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675796587221Flushing 1588230740/table: creating writer at 1675796587637 (+416 ms)Flushing 1588230740/table: appending metadata at 1675796587639 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796587639Flushing 1588230740/info: reopening flushed file at 1675796587653 (+14 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675796587660 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675796587666 (+6 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 496ms, sequenceid=57, compaction requested=false at 1675796587673 (+7 ms)Writing region close event to WAL at 1675796587677 (+4 ms)Running coprocessor post-close hooks at 1675796587681 (+4 ms)Closed at 1675796587682 (+1 ms) 2023-02-07 19:03:07,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:07,779 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,37771,1675796574811; all regions closed. 2023-02-07 19:03:07,785 DEBUG [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/oldWALs 2023-02-07 19:03:07,786 INFO [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C37771%2C1675796574811.meta:.meta(num 1675796576646) 2023-02-07 19:03:07,789 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/WALs/jenkins-hbase6.apache.org,37771,1675796574811/jenkins-hbase6.apache.org%2C37771%2C1675796574811.1675796577329 not finished, retry = 0 2023-02-07 19:03:07,892 DEBUG [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/oldWALs 2023-02-07 19:03:07,892 INFO [RS:0;jenkins-hbase6:37771] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C37771%2C1675796574811:(num 1675796577329) 2023-02-07 19:03:07,892 DEBUG [RS:0;jenkins-hbase6:37771] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,892 INFO [RS:0;jenkins-hbase6:37771] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:07,892 INFO [RS:0;jenkins-hbase6:37771] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:07,893 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:07,894 INFO [RS:0;jenkins-hbase6:37771] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:37771 2023-02-07 19:03:07,897 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,37771,1675796574811 2023-02-07 19:03:07,897 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:07,899 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,37771,1675796574811] 2023-02-07 19:03:07,899 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,37771,1675796574811; numProcessing=2 2023-02-07 19:03:07,901 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,37771,1675796574811 already deleted, retry=false 2023-02-07 19:03:07,901 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,37771,1675796574811 expired; onlineServers=0 2023-02-07 19:03:07,901 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,41363,1675796573627' ***** 2023-02-07 19:03:07,901 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:07,901 DEBUG [M:0;jenkins-hbase6:41363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d6d498, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:07,901 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,41363,1675796573627 2023-02-07 19:03:07,901 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,41363,1675796573627; all regions closed. 2023-02-07 19:03:07,902 DEBUG [M:0;jenkins-hbase6:41363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:07,902 DEBUG [M:0;jenkins-hbase6:41363] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:07,903 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:07,903 DEBUG [M:0;jenkins-hbase6:41363] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:07,903 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796576127] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796576127,5,FailOnTimeoutGroup] 2023-02-07 19:03:07,903 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796576126] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796576126,5,FailOnTimeoutGroup] 2023-02-07 19:03:07,903 INFO [M:0;jenkins-hbase6:41363] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:07,904 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:07,904 INFO [M:0;jenkins-hbase6:41363] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:07,904 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:07,904 INFO [M:0;jenkins-hbase6:41363] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:07,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:07,904 DEBUG [M:0;jenkins-hbase6:41363] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:07,905 INFO [M:0;jenkins-hbase6:41363] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:07,905 ERROR [M:0;jenkins-hbase6:41363] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-07 19:03:07,906 INFO [M:0;jenkins-hbase6:41363] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:07,906 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:07,906 DEBUG [M:0;jenkins-hbase6:41363] zookeeper.ZKUtil(398): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:07,906 WARN [M:0;jenkins-hbase6:41363] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:07,906 INFO [M:0;jenkins-hbase6:41363] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:07,907 INFO [M:0;jenkins-hbase6:41363] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:07,907 DEBUG [M:0;jenkins-hbase6:41363] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:07,907 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:07,907 DEBUG [M:0;jenkins-hbase6:41363] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:07,907 DEBUG [M:0;jenkins-hbase6:41363] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:07,907 DEBUG [M:0;jenkins-hbase6:41363] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:07,908 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.28 KB heapSize=192.19 KB 2023-02-07 19:03:07,930 INFO [M:0;jenkins-hbase6:41363] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.28 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a9af28cca16c4c799c5079f66a63ec43 2023-02-07 19:03:07,937 DEBUG [M:0;jenkins-hbase6:41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a9af28cca16c4c799c5079f66a63ec43 as hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a9af28cca16c4c799c5079f66a63ec43 2023-02-07 19:03:07,943 INFO [M:0;jenkins-hbase6:41363] regionserver.HStore(1080): Added hdfs://localhost:46511/user/jenkins/test-data/2b156ca4-3bc7-c83c-87dd-17a48ccca387/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a9af28cca16c4c799c5079f66a63ec43, entries=53, sequenceid=357, filesize=10.4 K 2023-02-07 19:03:07,944 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegion(2947): Finished flush of dataSize ~159.28 KB/163098, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=357, compaction requested=false 2023-02-07 19:03:07,946 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:07,946 DEBUG [M:0;jenkins-hbase6:41363] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796587907Disabling compacts and flushes for region at 1675796587907Disabling writes for close at 1675796587907Obtaining lock to block concurrent updates at 1675796587908 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796587908Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163098, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1675796587908Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796587909 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796587909Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796587914 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796587914Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796587938 (+24 ms)Finished flush of dataSize ~159.28 KB/163098, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=357, compaction requested=false at 1675796587945 (+7 ms)Writing region close event to WAL at 1675796587946 (+1 ms)Closed at 1675796587946 2023-02-07 19:03:07,951 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:07,951 INFO [M:0;jenkins-hbase6:41363] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:07,952 INFO [M:0;jenkins-hbase6:41363] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:41363 2023-02-07 19:03:07,955 DEBUG [M:0;jenkins-hbase6:41363] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,41363,1675796573627 already deleted, retry=false 2023-02-07 19:03:07,999 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:07,999 INFO [RS:0;jenkins-hbase6:37771] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,37771,1675796574811; zookeeper connection closed. 2023-02-07 19:03:07,999 ERROR [Listener at localhost/39659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@171549ce rejected from java.util.concurrent.ThreadPoolExecutor@132adff4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:07,999 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6c7e27a3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6c7e27a3 2023-02-07 19:03:07,999 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): regionserver:37771-0x1013e979e660001, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:07,999 ERROR [Listener at localhost/39659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ad2bb20 rejected from java.util.concurrent.ThreadPoolExecutor@132adff4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:08,000 INFO [Listener at localhost/39659] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:08,099 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:08,099 INFO [M:0;jenkins-hbase6:41363] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,41363,1675796573627; zookeeper connection closed. 2023-02-07 19:03:08,099 ERROR [Listener at localhost/39659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e65539d rejected from java.util.concurrent.ThreadPoolExecutor@60582bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:08,099 DEBUG [Listener at localhost/39659-EventThread] zookeeper.ZKWatcher(600): master:41363-0x1013e979e660000, quorum=127.0.0.1:51055, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:08,100 ERROR [Listener at localhost/39659-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6eb6504a rejected from java.util.concurrent.ThreadPoolExecutor@60582bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:08,102 WARN [Listener at localhost/39659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:08,105 INFO [Listener at localhost/39659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:08,209 WARN [BP-2085988263-172.31.2.20-1675796570166 heartbeating to localhost/127.0.0.1:46511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:08,209 WARN [BP-2085988263-172.31.2.20-1675796570166 heartbeating to localhost/127.0.0.1:46511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2085988263-172.31.2.20-1675796570166 (Datanode Uuid 944cb445-6a49-46a1-95c9-f75fa691e9be) service to localhost/127.0.0.1:46511 2023-02-07 19:03:08,211 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/dfs/data/data3/current/BP-2085988263-172.31.2.20-1675796570166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:08,211 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/dfs/data/data4/current/BP-2085988263-172.31.2.20-1675796570166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:08,212 WARN [Listener at localhost/39659] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:08,214 INFO [Listener at localhost/39659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:08,319 WARN [BP-2085988263-172.31.2.20-1675796570166 heartbeating to localhost/127.0.0.1:46511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:08,319 WARN [BP-2085988263-172.31.2.20-1675796570166 heartbeating to localhost/127.0.0.1:46511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2085988263-172.31.2.20-1675796570166 (Datanode Uuid 88b7d381-622d-4aac-8283-c12ac2223b09) service to localhost/127.0.0.1:46511 2023-02-07 19:03:08,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/dfs/data/data1/current/BP-2085988263-172.31.2.20-1675796570166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:08,320 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/cluster_e6bb5bde-e6aa-b9df-dcf8-1054b2a6fab2/dfs/data/data2/current/BP-2085988263-172.31.2.20-1675796570166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:08,350 INFO [Listener at localhost/39659] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:08,471 INFO [Listener at localhost/39659] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:08,537 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:08,551 INFO [Listener at localhost/39659] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:46511 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:46511 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:46511 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/39659 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase6:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:46511 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:46511 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46511 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@71873538 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,41363,1675796573627)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase6:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:46511 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase6:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase6:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=548 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=372 (was 274) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=5014 (was 6083) 2023-02-07 19:03:08,560 INFO [Listener at localhost/39659] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=548, MaxFileDescriptor=60000, SystemLoadAverage=372, ProcessCount=169, AvailableMemoryMB=5014 2023-02-07 19:03:08,570 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop.log.dir so I do NOT create it in target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c 2023-02-07 19:03:08,571 WARN [Listener at localhost/39659] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop.tmp.dir so I do NOT create it in target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c 2023-02-07 19:03:08,571 WARN [Listener at localhost/39659] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/03d92715-8645-2276-30c1-fedc5595c448/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 19:03:08,571 DEBUG [Listener at localhost/39659] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e, deleteOnExit=true 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/test.cache.data in system properties and HBase conf 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:03:08,571 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:03:08,572 DEBUG [Listener at localhost/39659] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:03:08,572 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:03:08,573 INFO [Listener at localhost/39659] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:03:08,577 WARN [Listener at localhost/39659] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:08,578 WARN [Listener at localhost/39659] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:08,626 WARN [Listener at localhost/39659] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:08,628 INFO [Listener at localhost/39659] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:08,632 INFO [Listener at localhost/39659] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/java.io.tmpdir/Jetty_localhost_43875_hdfs____.3ucbhb/webapp 2023-02-07 19:03:08,725 INFO [Listener at localhost/39659] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43875 2023-02-07 19:03:08,729 WARN [Listener at localhost/39659] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:08,729 WARN [Listener at localhost/39659] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:08,773 WARN [Listener at localhost/40767] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:08,789 WARN [Listener at localhost/40767] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:08,794 WARN [Listener at localhost/40767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:08,795 INFO [Listener at localhost/40767] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:08,800 INFO [Listener at localhost/40767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/java.io.tmpdir/Jetty_localhost_34063_datanode____ybnob7/webapp 2023-02-07 19:03:08,902 INFO [Listener at localhost/40767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34063 2023-02-07 19:03:08,911 WARN [Listener at localhost/40849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:08,938 WARN [Listener at localhost/40849] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:08,941 WARN [Listener at localhost/40849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:08,942 INFO [Listener at localhost/40849] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:08,949 INFO [Listener at localhost/40849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/java.io.tmpdir/Jetty_localhost_42801_datanode____.m8gcri/webapp 2023-02-07 19:03:09,053 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf55a2da51b2be00a: Processing first storage report for DS-8078afe8-49e5-49c0-9495-2508cffbf00a from datanode 4b2222ea-8f3b-4f48-af41-89c3fecd653d 2023-02-07 19:03:09,054 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf55a2da51b2be00a: from storage DS-8078afe8-49e5-49c0-9495-2508cffbf00a node DatanodeRegistration(127.0.0.1:36223, datanodeUuid=4b2222ea-8f3b-4f48-af41-89c3fecd653d, infoPort=44401, infoSecurePort=0, ipcPort=40849, storageInfo=lv=-57;cid=testClusterID;nsid=1043506530;c=1675796588580), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:09,054 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf55a2da51b2be00a: Processing first storage report for DS-dfd7e3c9-6b98-4ad6-b71b-b083ea72bc62 from datanode 4b2222ea-8f3b-4f48-af41-89c3fecd653d 2023-02-07 19:03:09,054 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf55a2da51b2be00a: from storage DS-dfd7e3c9-6b98-4ad6-b71b-b083ea72bc62 node DatanodeRegistration(127.0.0.1:36223, datanodeUuid=4b2222ea-8f3b-4f48-af41-89c3fecd653d, infoPort=44401, infoSecurePort=0, ipcPort=40849, storageInfo=lv=-57;cid=testClusterID;nsid=1043506530;c=1675796588580), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:09,087 INFO [Listener at localhost/40849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42801 2023-02-07 19:03:09,101 WARN [Listener at localhost/41793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:09,205 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6322dfd4665dc05c: Processing first storage report for DS-c95815dc-18c9-4efe-bef5-28e02e384c64 from datanode 2d4e3f54-ebfa-49bf-b6ea-b0947062206e 2023-02-07 19:03:09,205 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6322dfd4665dc05c: from storage DS-c95815dc-18c9-4efe-bef5-28e02e384c64 node DatanodeRegistration(127.0.0.1:33341, datanodeUuid=2d4e3f54-ebfa-49bf-b6ea-b0947062206e, infoPort=46747, infoSecurePort=0, ipcPort=41793, storageInfo=lv=-57;cid=testClusterID;nsid=1043506530;c=1675796588580), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:09,205 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6322dfd4665dc05c: Processing first storage report for DS-975b97b6-b5ad-4f77-b68a-36e0f60c2376 from datanode 2d4e3f54-ebfa-49bf-b6ea-b0947062206e 2023-02-07 19:03:09,205 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6322dfd4665dc05c: from storage DS-975b97b6-b5ad-4f77-b68a-36e0f60c2376 node DatanodeRegistration(127.0.0.1:33341, datanodeUuid=2d4e3f54-ebfa-49bf-b6ea-b0947062206e, infoPort=46747, infoSecurePort=0, ipcPort=41793, storageInfo=lv=-57;cid=testClusterID;nsid=1043506530;c=1675796588580), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:09,217 DEBUG [Listener at localhost/41793] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c 2023-02-07 19:03:09,223 INFO [Listener at localhost/41793] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/zookeeper_0, clientPort=53592, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:03:09,224 INFO [Listener at localhost/41793] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53592 2023-02-07 19:03:09,224 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,225 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,245 INFO [Listener at localhost/41793] util.FSUtils(479): Created version file at hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f with version=8 2023-02-07 19:03:09,245 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,246 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,247 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/hbase-staging 2023-02-07 19:03:09,249 INFO [Listener at localhost/41793] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:09,249 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,249 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,249 INFO [Listener at localhost/41793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:09,249 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,250 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:09,250 INFO [Listener at localhost/41793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:09,251 INFO [Listener at localhost/41793] ipc.NettyRpcServer(120): Bind to /172.31.2.20:34499 2023-02-07 19:03:09,252 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,252 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,253 INFO [Listener at localhost/41793] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34499 connecting to ZooKeeper ensemble=127.0.0.1:53592 2023-02-07 19:03:09,262 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:344990x0, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:09,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34499-0x1013e97dee80000 connected 2023-02-07 19:03:09,289 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:09,290 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:09,290 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:09,293 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34499 2023-02-07 19:03:09,293 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34499 2023-02-07 19:03:09,294 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34499 2023-02-07 19:03:09,296 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34499 2023-02-07 19:03:09,297 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34499 2023-02-07 19:03:09,297 INFO [Listener at localhost/41793] master.HMaster(439): hbase.rootdir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f, hbase.cluster.distributed=false 2023-02-07 19:03:09,311 INFO [Listener at localhost/41793] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:09,311 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,311 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,312 INFO [Listener at localhost/41793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:09,312 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,312 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:09,312 INFO [Listener at localhost/41793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:09,314 INFO [Listener at localhost/41793] ipc.NettyRpcServer(120): Bind to /172.31.2.20:46143 2023-02-07 19:03:09,315 INFO [Listener at localhost/41793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:09,319 DEBUG [Listener at localhost/41793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:09,319 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,321 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,322 INFO [Listener at localhost/41793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46143 connecting to ZooKeeper ensemble=127.0.0.1:53592 2023-02-07 19:03:09,325 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:461430x0, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:09,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46143-0x1013e97dee80001 connected 2023-02-07 19:03:09,326 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:09,327 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:09,328 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:09,330 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46143 2023-02-07 19:03:09,333 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46143 2023-02-07 19:03:09,334 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46143 2023-02-07 19:03:09,334 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46143 2023-02-07 19:03:09,334 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46143 2023-02-07 19:03:09,353 INFO [Listener at localhost/41793] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:09,354 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,354 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,354 INFO [Listener at localhost/41793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:09,354 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:09,354 INFO [Listener at localhost/41793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:09,354 INFO [Listener at localhost/41793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:09,356 INFO [Listener at localhost/41793] ipc.NettyRpcServer(120): Bind to /172.31.2.20:41593 2023-02-07 19:03:09,357 INFO [Listener at localhost/41793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:09,358 DEBUG [Listener at localhost/41793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:09,358 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,360 INFO [Listener at localhost/41793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,361 INFO [Listener at localhost/41793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41593 connecting to ZooKeeper ensemble=127.0.0.1:53592 2023-02-07 19:03:09,366 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:415930x0, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:09,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41593-0x1013e97dee80002 connected 2023-02-07 19:03:09,367 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:09,367 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:09,368 DEBUG [Listener at localhost/41793] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:09,370 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41593 2023-02-07 19:03:09,370 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41593 2023-02-07 19:03:09,374 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41593 2023-02-07 19:03:09,374 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41593 2023-02-07 19:03:09,374 DEBUG [Listener at localhost/41793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41593 2023-02-07 19:03:09,375 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,378 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:09,378 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,380 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:09,380 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:09,380 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:09,380 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:09,383 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:09,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:09,383 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,34499,1675796589249 from backup master directory 2023-02-07 19:03:09,385 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,385 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:09,385 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:09,385 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,403 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/hbase.id with ID: 4bfbccad-bd11-4fc6-a3b9-002051fa5446 2023-02-07 19:03:09,416 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:09,419 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:09,434 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0dd626ca to 127.0.0.1:53592 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:09,441 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73b01779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:09,441 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:09,442 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:03:09,442 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:09,443 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store-tmp 2023-02-07 19:03:09,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:09,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:09,855 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:09,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:09,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:09,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:09,855 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:09,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796589855Disabling compacts and flushes for region at 1675796589855Disabling writes for close at 1675796589855Writing region close event to WAL at 1675796589855Closed at 1675796589855 2023-02-07 19:03:09,856 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/WALs/jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,859 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C34499%2C1675796589249, suffix=, logDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/WALs/jenkins-hbase6.apache.org,34499,1675796589249, archiveDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/oldWALs, maxLogs=10 2023-02-07 19:03:09,876 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK] 2023-02-07 19:03:09,878 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK] 2023-02-07 19:03:09,880 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/WALs/jenkins-hbase6.apache.org,34499,1675796589249/jenkins-hbase6.apache.org%2C34499%2C1675796589249.1675796589860 2023-02-07 19:03:09,880 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK]] 2023-02-07 19:03:09,880 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:09,880 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:09,880 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:09,880 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:09,882 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:09,883 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:03:09,883 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:03:09,884 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:09,885 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:09,885 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:09,888 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:09,890 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:09,891 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73596472, jitterRate=0.0966728925704956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:09,891 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796589881Initializing all the Stores at 1675796589881Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796589881Cleaning up temporary data from old regions at 1675796589886 (+5 ms)Cleaning up detritus from prior splits at 1675796589886Region opened successfully at 1675796589891 (+5 ms) 2023-02-07 19:03:09,894 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:03:09,895 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:03:09,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:03:09,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:03:09,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 19:03:09,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 19:03:09,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:03:09,901 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:03:09,902 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:03:09,913 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:03:09,913 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:03:09,913 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:03:09,913 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:03:09,914 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:03:09,916 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:09,916 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:03:09,917 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:03:09,918 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:03:09,919 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:09,919 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:09,920 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:09,919 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:09,920 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,34499,1675796589249, sessionid=0x1013e97dee80000, setting cluster-up flag (Was=false) 2023-02-07 19:03:09,925 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:09,930 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:03:09,931 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,934 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:09,940 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:03:09,941 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:09,941 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.hbase-snapshot/.tmp 2023-02-07 19:03:09,943 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:09,944 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796619948 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:03:09,948 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:03:09,950 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:09,950 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:09,951 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:03:09,951 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:03:09,951 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:03:09,951 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:03:09,952 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:03:09,952 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:03:09,952 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796589952,5,FailOnTimeoutGroup] 2023-02-07 19:03:09,952 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796589952,5,FailOnTimeoutGroup] 2023-02-07 19:03:09,952 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:09,952 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:03:09,952 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:09,952 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:09,952 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:09,964 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:09,964 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:09,965 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f 2023-02-07 19:03:09,972 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:09,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:09,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/info 2023-02-07 19:03:09,975 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:09,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:09,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:09,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:09,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:09,978 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(952): ClusterId : 4bfbccad-bd11-4fc6-a3b9-002051fa5446 2023-02-07 19:03:09,978 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(952): ClusterId : 4bfbccad-bd11-4fc6-a3b9-002051fa5446 2023-02-07 19:03:09,978 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:09,978 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:09,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:09,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:09,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/table 2023-02-07 19:03:09,981 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:09,981 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:09,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:09,981 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:09,981 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:09,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:09,982 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740 2023-02-07 19:03:09,982 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740 2023-02-07 19:03:09,984 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:09,985 DEBUG [RS:0;jenkins-hbase6:46143] zookeeper.ReadOnlyZKClient(139): Connect 0x3b1c6c4a to 127.0.0.1:53592 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:09,985 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:09,987 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:09,987 DEBUG [RS:1;jenkins-hbase6:41593] zookeeper.ReadOnlyZKClient(139): Connect 0x6537bbbe to 127.0.0.1:53592 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:09,991 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:09,999 DEBUG [RS:0;jenkins-hbase6:46143] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35db9559, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:09,999 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:09,999 DEBUG [RS:0;jenkins-hbase6:46143] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31e4073a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:10,000 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63055850, jitterRate=-0.060394614934921265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:10,000 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796589972Initializing all the Stores at 1675796589973 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796589973Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796589973Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796589973Cleaning up temporary data from old regions at 1675796589983 (+10 ms)Cleaning up detritus from prior splits at 1675796589984 (+1 ms)Region opened successfully at 1675796590000 (+16 ms) 2023-02-07 19:03:10,000 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:10,000 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:10,000 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:10,000 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:10,000 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:10,002 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:10,003 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796590000Disabling compacts and flushes for region at 1675796590000Disabling writes for close at 1675796590000Writing region close event to WAL at 1675796590002 (+2 ms)Closed at 1675796590002 2023-02-07 19:03:10,003 DEBUG [RS:1;jenkins-hbase6:41593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bf04968, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:10,003 DEBUG [RS:1;jenkins-hbase6:41593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fcfd0ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:10,004 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:10,004 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:03:10,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:03:10,006 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:03:10,007 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:03:10,010 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:46143 2023-02-07 19:03:10,010 INFO [RS:0;jenkins-hbase6:46143] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:10,010 INFO [RS:0;jenkins-hbase6:46143] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:10,010 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:10,011 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,34499,1675796589249 with isa=jenkins-hbase6.apache.org/172.31.2.20:46143, startcode=1675796589311 2023-02-07 19:03:10,011 DEBUG [RS:0;jenkins-hbase6:46143] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:10,013 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47001, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:10,014 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:41593 2023-02-07 19:03:10,014 INFO [RS:1;jenkins-hbase6:41593] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:10,014 INFO [RS:1;jenkins-hbase6:41593] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:10,014 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:10,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,015 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,34499,1675796589249 with isa=jenkins-hbase6.apache.org/172.31.2.20:41593, startcode=1675796589353 2023-02-07 19:03:10,015 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f 2023-02-07 19:03:10,015 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40767 2023-02-07 19:03:10,015 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:10,015 DEBUG [RS:1;jenkins-hbase6:41593] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:10,018 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:10,018 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35751, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:10,019 DEBUG [RS:0;jenkins-hbase6:46143] zookeeper.ZKUtil(162): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,019 WARN [RS:0;jenkins-hbase6:46143] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:10,019 INFO [RS:0;jenkins-hbase6:46143] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:10,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,019 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,020 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f 2023-02-07 19:03:10,020 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40767 2023-02-07 19:03:10,020 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:10,021 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,46143,1675796589311] 2023-02-07 19:03:10,026 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:10,026 DEBUG [RS:1;jenkins-hbase6:41593] zookeeper.ZKUtil(162): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,026 WARN [RS:1;jenkins-hbase6:41593] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:10,027 INFO [RS:1;jenkins-hbase6:41593] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:10,027 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,41593,1675796589353] 2023-02-07 19:03:10,027 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,027 DEBUG [RS:0;jenkins-hbase6:46143] zookeeper.ZKUtil(162): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,028 DEBUG [RS:0;jenkins-hbase6:46143] zookeeper.ZKUtil(162): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,030 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:10,030 INFO [RS:0;jenkins-hbase6:46143] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:10,031 DEBUG [RS:1;jenkins-hbase6:41593] zookeeper.ZKUtil(162): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,031 DEBUG [RS:1;jenkins-hbase6:41593] zookeeper.ZKUtil(162): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,032 INFO [RS:0;jenkins-hbase6:46143] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:10,034 INFO [RS:0;jenkins-hbase6:46143] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:10,035 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,035 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:10,035 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:10,035 INFO [RS:1;jenkins-hbase6:41593] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:10,037 INFO [RS:1;jenkins-hbase6:41593] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:10,038 INFO [RS:1;jenkins-hbase6:41593] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:10,038 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,038 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:10,039 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,039 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:0;jenkins-hbase6:46143] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,040 DEBUG [RS:1;jenkins-hbase6:41593] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:10,051 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,052 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,052 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,052 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,052 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,052 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,063 INFO [RS:1;jenkins-hbase6:41593] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:10,064 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,41593,1675796589353-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,067 INFO [RS:0;jenkins-hbase6:46143] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:10,067 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46143,1675796589311-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,079 INFO [RS:1;jenkins-hbase6:41593] regionserver.Replication(203): jenkins-hbase6.apache.org,41593,1675796589353 started 2023-02-07 19:03:10,079 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,41593,1675796589353, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:41593, sessionid=0x1013e97dee80002 2023-02-07 19:03:10,079 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:10,079 DEBUG [RS:1;jenkins-hbase6:41593] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,079 DEBUG [RS:1;jenkins-hbase6:41593] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,41593,1675796589353' 2023-02-07 19:03:10,079 DEBUG [RS:1;jenkins-hbase6:41593] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:10,080 DEBUG [RS:1;jenkins-hbase6:41593] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:10,080 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:10,080 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:10,080 DEBUG [RS:1;jenkins-hbase6:41593] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,080 DEBUG [RS:1;jenkins-hbase6:41593] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,41593,1675796589353' 2023-02-07 19:03:10,080 DEBUG [RS:1;jenkins-hbase6:41593] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:10,081 DEBUG [RS:1;jenkins-hbase6:41593] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:10,081 DEBUG [RS:1;jenkins-hbase6:41593] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:10,081 INFO [RS:1;jenkins-hbase6:41593] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:10,081 INFO [RS:1;jenkins-hbase6:41593] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:10,086 INFO [RS:0;jenkins-hbase6:46143] regionserver.Replication(203): jenkins-hbase6.apache.org,46143,1675796589311 started 2023-02-07 19:03:10,086 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,46143,1675796589311, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:46143, sessionid=0x1013e97dee80001 2023-02-07 19:03:10,086 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:10,086 DEBUG [RS:0;jenkins-hbase6:46143] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,087 DEBUG [RS:0;jenkins-hbase6:46143] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46143,1675796589311' 2023-02-07 19:03:10,087 DEBUG [RS:0;jenkins-hbase6:46143] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:10,087 DEBUG [RS:0;jenkins-hbase6:46143] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:10,087 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:10,088 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:10,088 DEBUG [RS:0;jenkins-hbase6:46143] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,088 DEBUG [RS:0;jenkins-hbase6:46143] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46143,1675796589311' 2023-02-07 19:03:10,088 DEBUG [RS:0;jenkins-hbase6:46143] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:10,088 DEBUG [RS:0;jenkins-hbase6:46143] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:10,094 DEBUG [RS:0;jenkins-hbase6:46143] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:10,095 INFO [RS:0;jenkins-hbase6:46143] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:10,095 INFO [RS:0;jenkins-hbase6:46143] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:10,157 DEBUG [jenkins-hbase6:34499] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:03:10,158 DEBUG [jenkins-hbase6:34499] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:10,160 DEBUG [jenkins-hbase6:34499] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:10,160 DEBUG [jenkins-hbase6:34499] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:10,160 DEBUG [jenkins-hbase6:34499] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:10,160 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,41593,1675796589353, state=OPENING 2023-02-07 19:03:10,162 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:03:10,164 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:10,164 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:10,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,41593,1675796589353}] 2023-02-07 19:03:10,319 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:10,319 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:10,322 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:10,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:03:10,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:10,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C41593%2C1675796589353.meta, suffix=.meta, logDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,41593,1675796589353, archiveDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/oldWALs, maxLogs=32 2023-02-07 19:03:10,345 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK] 2023-02-07 19:03:10,345 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK] 2023-02-07 19:03:10,347 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,41593,1675796589353/jenkins-hbase6.apache.org%2C41593%2C1675796589353.meta.1675796590329.meta 2023-02-07 19:03:10,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK], DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK]] 2023-02-07 19:03:10,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:10,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:03:10,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:03:10,349 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:03:10,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:03:10,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:10,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:03:10,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:03:10,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:10,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/info 2023-02-07 19:03:10,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/info 2023-02-07 19:03:10,352 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:10,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:10,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:10,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:10,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:10,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:10,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:10,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:10,356 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/table 2023-02-07 19:03:10,356 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/table 2023-02-07 19:03:10,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:10,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:10,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740 2023-02-07 19:03:10,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740 2023-02-07 19:03:10,362 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:10,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:10,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65886434, jitterRate=-0.01821562647819519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:10,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796590350Writing region info on filesystem at 1675796590350Initializing all the Stores at 1675796590350Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796590350Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796590351 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796590351Cleaning up temporary data from old regions at 1675796590361 (+10 ms)Cleaning up detritus from prior splits at 1675796590361Running coprocessor post-open hooks at 1675796590365 (+4 ms)Region opened successfully at 1675796590365 2023-02-07 19:03:10,366 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796590319 2023-02-07 19:03:10,370 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:03:10,370 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:03:10,371 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,41593,1675796589353, state=OPEN 2023-02-07 19:03:10,372 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:03:10,372 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:10,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:03:10,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,41593,1675796589353 in 208 msec 2023-02-07 19:03:10,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:03:10,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 371 msec 2023-02-07 19:03:10,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 436 msec 2023-02-07 19:03:10,379 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796589378, completionTime=-1 2023-02-07 19:03:10,379 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:03:10,379 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:03:10,388 DEBUG [hconnection-0x317c37e0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:10,390 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:10,392 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:03:10,392 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796650392 2023-02-07 19:03:10,392 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796710392 2023-02-07 19:03:10,392 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 13 msec 2023-02-07 19:03:10,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34499,1675796589249-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34499,1675796589249-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34499,1675796589249-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:34499, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,402 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:10,402 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:03:10,402 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:10,403 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:03:10,422 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:10,422 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:03:10,423 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:10,425 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,425 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff empty. 2023-02-07 19:03:10,426 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,426 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:03:10,448 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:10,449 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f2297cc7bdc83633ccb0a89bae7b2bff, NAME => 'hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:10,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:10,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f2297cc7bdc83633ccb0a89bae7b2bff, disabling compactions & flushes 2023-02-07 19:03:10,469 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. after waiting 0 ms 2023-02-07 19:03:10,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,470 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f2297cc7bdc83633ccb0a89bae7b2bff: Waiting for close lock at 1675796590469Disabling compacts and flushes for region at 1675796590469Disabling writes for close at 1675796590470 (+1 ms)Writing region close event to WAL at 1675796590470Closed at 1675796590470 2023-02-07 19:03:10,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:10,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796590474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796590474"}]},"ts":"1675796590474"} 2023-02-07 19:03:10,477 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:10,478 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:10,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796590479"}]},"ts":"1675796590479"} 2023-02-07 19:03:10,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:03:10,484 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:10,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:10,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:10,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:10,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f2297cc7bdc83633ccb0a89bae7b2bff, ASSIGN}] 2023-02-07 19:03:10,488 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f2297cc7bdc83633ccb0a89bae7b2bff, ASSIGN 2023-02-07 19:03:10,489 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f2297cc7bdc83633ccb0a89bae7b2bff, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46143,1675796589311; forceNewPlan=false, retain=false 2023-02-07 19:03:10,639 INFO [jenkins-hbase6:34499] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:10,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f2297cc7bdc83633ccb0a89bae7b2bff, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,641 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796590640"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796590640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796590640"}]},"ts":"1675796590640"} 2023-02-07 19:03:10,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f2297cc7bdc83633ccb0a89bae7b2bff, server=jenkins-hbase6.apache.org,46143,1675796589311}] 2023-02-07 19:03:10,796 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,796 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:10,799 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45152, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:10,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,809 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46143%2C1675796589311, suffix=, logDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,46143,1675796589311, archiveDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/oldWALs, maxLogs=32 2023-02-07 19:03:10,833 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK] 2023-02-07 19:03:10,833 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK] 2023-02-07 19:03:10,837 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,46143,1675796589311/jenkins-hbase6.apache.org%2C46143%2C1675796589311.1675796590810 2023-02-07 19:03:10,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK], DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK]] 2023-02-07 19:03:10,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f2297cc7bdc83633ccb0a89bae7b2bff, NAME => 'hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:10,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:10,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,839 INFO [StoreOpener-f2297cc7bdc83633ccb0a89bae7b2bff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,841 DEBUG [StoreOpener-f2297cc7bdc83633ccb0a89bae7b2bff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/info 2023-02-07 19:03:10,841 DEBUG [StoreOpener-f2297cc7bdc83633ccb0a89bae7b2bff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/info 2023-02-07 19:03:10,842 INFO [StoreOpener-f2297cc7bdc83633ccb0a89bae7b2bff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2297cc7bdc83633ccb0a89bae7b2bff columnFamilyName info 2023-02-07 19:03:10,842 INFO [StoreOpener-f2297cc7bdc83633ccb0a89bae7b2bff-1] regionserver.HStore(310): Store=f2297cc7bdc83633ccb0a89bae7b2bff/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:10,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:10,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:10,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened f2297cc7bdc83633ccb0a89bae7b2bff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61013870, jitterRate=-0.0908224880695343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:10,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for f2297cc7bdc83633ccb0a89bae7b2bff: Running coprocessor pre-open hook at 1675796590838Writing region info on filesystem at 1675796590838Initializing all the Stores at 1675796590839 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796590839Cleaning up temporary data from old regions at 1675796590844 (+5 ms)Cleaning up detritus from prior splits at 1675796590845 (+1 ms)Running coprocessor post-open hooks at 1675796590850 (+5 ms)Region opened successfully at 1675796590850 2023-02-07 19:03:10,851 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff., pid=6, masterSystemTime=1675796590796 2023-02-07 19:03:10,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,855 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:10,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f2297cc7bdc83633ccb0a89bae7b2bff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:10,856 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796590855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796590855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796590855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796590855"}]},"ts":"1675796590855"} 2023-02-07 19:03:10,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:03:10,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f2297cc7bdc83633ccb0a89bae7b2bff, server=jenkins-hbase6.apache.org,46143,1675796589311 in 213 msec 2023-02-07 19:03:10,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:03:10,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f2297cc7bdc83633ccb0a89bae7b2bff, ASSIGN in 375 msec 2023-02-07 19:03:10,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:10,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796590863"}]},"ts":"1675796590863"} 2023-02-07 19:03:10,864 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:03:10,867 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:10,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 465 msec 2023-02-07 19:03:10,904 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:03:10,905 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:10,905 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:10,909 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:10,915 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:10,918 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:03:10,926 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:10,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-07 19:03:10,939 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:03:10,950 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:10,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-07 19:03:10,964 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:03:10,967 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:03:10,967 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.582sec 2023-02-07 19:03:10,968 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:03:10,968 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:03:10,968 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:03:10,968 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34499,1675796589249-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:03:10,968 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34499,1675796589249-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:03:10,970 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:03:10,978 DEBUG [Listener at localhost/41793] zookeeper.ReadOnlyZKClient(139): Connect 0x05c506c3 to 127.0.0.1:53592 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:10,988 DEBUG [Listener at localhost/41793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c6a4fc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:10,989 DEBUG [hconnection-0x30448096-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:10,993 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:10,994 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:10,995 DEBUG [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:03:10,995 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:10,995 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:10,998 DEBUG [Listener at localhost/41793] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:03:11,000 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33394, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:03:11,001 INFO [Listener at localhost/41793] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 19:03:11,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-07 19:03:11,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:03:11,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.2.20:33394 deadline: 1675796651002, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 19:03:11,003 INFO [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 19:03:11,003 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:11,003 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:11,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:11,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 19:03:11,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:11,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 19:03:11,010 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:11,010 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:11,010 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:11,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:11,019 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:11,019 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,019 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,019 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,020 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:11,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5 empty. 2023-02-07 19:03:11,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,020 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc empty. 2023-02-07 19:03:11,021 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775 empty. 2023-02-07 19:03:11,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3 empty. 2023-02-07 19:03:11,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5 empty. 2023-02-07 19:03:11,021 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c empty. 2023-02-07 19:03:11,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963 empty. 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce empty. 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,022 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:11,023 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe empty. 2023-02-07 19:03:11,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228 empty. 2023-02-07 19:03:11,023 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,023 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 19:03:11,047 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:11,048 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4b9640448e0ff51eef07fadfdafd31a5, NAME => 'testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 49c9390b12f04bdca9455e0385741c4c, NAME => 'testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 844d12f763403a7a07be89b8253371cc, NAME => 'testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,112 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:11,115 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:11,116 INFO [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C41593%2C1675796589353, suffix=, logDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,41593,1675796589353, archiveDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/oldWALs, maxLogs=32 2023-02-07 19:03:11,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:11,120 WARN [DataStreamer for file /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/.regioninfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-07 19:03:11,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4b9640448e0ff51eef07fadfdafd31a5, disabling compactions & flushes 2023-02-07 19:03:11,122 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:11,122 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:11,122 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. after waiting 0 ms 2023-02-07 19:03:11,122 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:11,122 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:11,122 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4b9640448e0ff51eef07fadfdafd31a5: Waiting for close lock at 1675796591121Disabling compacts and flushes for region at 1675796591121Disabling writes for close at 1675796591122 (+1 ms)Writing region close event to WAL at 1675796591122Closed at 1675796591122 2023-02-07 19:03:11,122 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a60692693abae60624586adf40a8dfce, NAME => 'testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 49c9390b12f04bdca9455e0385741c4c, disabling compactions & flushes 2023-02-07 19:03:11,124 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. after waiting 0 ms 2023-02-07 19:03:11,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,124 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,124 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 49c9390b12f04bdca9455e0385741c4c: Waiting for close lock at 1675796591124Disabling compacts and flushes for region at 1675796591124Disabling writes for close at 1675796591124Writing region close event to WAL at 1675796591124Closed at 1675796591124 2023-02-07 19:03:11,124 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => bae1c0d970d6fa537deb42aa4ca65775, NAME => 'testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a60692693abae60624586adf40a8dfce, disabling compactions & flushes 2023-02-07 19:03:11,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. after waiting 0 ms 2023-02-07 19:03:11,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a60692693abae60624586adf40a8dfce: Waiting for close lock at 1675796591140Disabling compacts and flushes for region at 1675796591140Disabling writes for close at 1675796591140Writing region close event to WAL at 1675796591140Closed at 1675796591140 2023-02-07 19:03:11,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e097679fa367eb82dbd32a7d37f4e963, NAME => 'testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,145 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,145 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 844d12f763403a7a07be89b8253371cc, disabling compactions & flushes 2023-02-07 19:03:11,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:11,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:11,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. after waiting 0 ms 2023-02-07 19:03:11,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:11,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:11,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 844d12f763403a7a07be89b8253371cc: Waiting for close lock at 1675796591145Disabling compacts and flushes for region at 1675796591145Disabling writes for close at 1675796591146 (+1 ms)Writing region close event to WAL at 1675796591146Closed at 1675796591146 2023-02-07 19:03:11,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1b48fe07f2712b47c4e01783fe6b02a3, NAME => 'testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,151 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK] 2023-02-07 19:03:11,151 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK] 2023-02-07 19:03:11,153 INFO [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/WALs/jenkins-hbase6.apache.org,41593,1675796589353/jenkins-hbase6.apache.org%2C41593%2C1675796589353.1675796591117 2023-02-07 19:03:11,155 DEBUG [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36223,DS-8078afe8-49e5-49c0-9495-2508cffbf00a,DISK], DatanodeInfoWithStorage[127.0.0.1:33341,DS-c95815dc-18c9-4efe-bef5-28e02e384c64,DISK]] 2023-02-07 19:03:11,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1b48fe07f2712b47c4e01783fe6b02a3, disabling compactions & flushes 2023-02-07 19:03:11,157 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. after waiting 0 ms 2023-02-07 19:03:11,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,157 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1b48fe07f2712b47c4e01783fe6b02a3: Waiting for close lock at 1675796591157Disabling compacts and flushes for region at 1675796591157Disabling writes for close at 1675796591157Writing region close event to WAL at 1675796591157Closed at 1675796591157 2023-02-07 19:03:11,158 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3171d9d95a634937d91b9dc1f3b8a8a5, NAME => 'testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e097679fa367eb82dbd32a7d37f4e963, disabling compactions & flushes 2023-02-07 19:03:11,159 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:11,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:11,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. after waiting 0 ms 2023-02-07 19:03:11,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:11,159 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:11,159 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e097679fa367eb82dbd32a7d37f4e963: Waiting for close lock at 1675796591159Disabling compacts and flushes for region at 1675796591159Disabling writes for close at 1675796591159Writing region close event to WAL at 1675796591159Closed at 1675796591159 2023-02-07 19:03:11,159 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 32646fb15d4909afb5300285d9a88228, NAME => 'testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 32646fb15d4909afb5300285d9a88228, disabling compactions & flushes 2023-02-07 19:03:11,168 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. after waiting 0 ms 2023-02-07 19:03:11,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,168 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 32646fb15d4909afb5300285d9a88228: Waiting for close lock at 1675796591168Disabling compacts and flushes for region at 1675796591168Disabling writes for close at 1675796591168Writing region close event to WAL at 1675796591168Closed at 1675796591168 2023-02-07 19:03:11,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b60f373395365bab4d169e7de139a9fe, NAME => 'testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.tmp 2023-02-07 19:03:11,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3171d9d95a634937d91b9dc1f3b8a8a5, disabling compactions & flushes 2023-02-07 19:03:11,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. after waiting 0 ms 2023-02-07 19:03:11,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3171d9d95a634937d91b9dc1f3b8a8a5: Waiting for close lock at 1675796591171Disabling compacts and flushes for region at 1675796591171Disabling writes for close at 1675796591171Writing region close event to WAL at 1675796591171Closed at 1675796591171 2023-02-07 19:03:11,176 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b60f373395365bab4d169e7de139a9fe, disabling compactions & flushes 2023-02-07 19:03:11,177 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:11,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:11,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. after waiting 0 ms 2023-02-07 19:03:11,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:11,177 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:11,177 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b60f373395365bab4d169e7de139a9fe: Waiting for close lock at 1675796591177Disabling compacts and flushes for region at 1675796591177Disabling writes for close at 1675796591177Writing region close event to WAL at 1675796591177Closed at 1675796591177 2023-02-07 19:03:11,317 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:11,317 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:11,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:11,541 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,541 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing bae1c0d970d6fa537deb42aa4ca65775, disabling compactions & flushes 2023-02-07 19:03:11,541 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,541 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,541 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. after waiting 0 ms 2023-02-07 19:03:11,541 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,541 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,541 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for bae1c0d970d6fa537deb42aa4ca65775: Waiting for close lock at 1675796591541Disabling compacts and flushes for region at 1675796591541Disabling writes for close at 1675796591541Writing region close event to WAL at 1675796591541Closed at 1675796591541 2023-02-07 19:03:11,546 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675796591005.a60692693abae60624586adf40a8dfce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675796591005.844d12f763403a7a07be89b8253371cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,549 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796591547"}]},"ts":"1675796591547"} 2023-02-07 19:03:11,555 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 19:03:11,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:11,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796591556"}]},"ts":"1675796591556"} 2023-02-07 19:03:11,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 19:03:11,562 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:11,571 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:11,571 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:11,571 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:11,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4b9640448e0ff51eef07fadfdafd31a5, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=49c9390b12f04bdca9455e0385741c4c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=844d12f763403a7a07be89b8253371cc, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a60692693abae60624586adf40a8dfce, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bae1c0d970d6fa537deb42aa4ca65775, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e097679fa367eb82dbd32a7d37f4e963, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1b48fe07f2712b47c4e01783fe6b02a3, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3171d9d95a634937d91b9dc1f3b8a8a5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=32646fb15d4909afb5300285d9a88228, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b60f373395365bab4d169e7de139a9fe, ASSIGN}] 2023-02-07 19:03:11,574 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=49c9390b12f04bdca9455e0385741c4c, ASSIGN 2023-02-07 19:03:11,575 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=49c9390b12f04bdca9455e0385741c4c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46143,1675796589311; forceNewPlan=false, retain=false 2023-02-07 19:03:11,576 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1b48fe07f2712b47c4e01783fe6b02a3, ASSIGN 2023-02-07 19:03:11,576 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3171d9d95a634937d91b9dc1f3b8a8a5, ASSIGN 2023-02-07 19:03:11,576 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4b9640448e0ff51eef07fadfdafd31a5, ASSIGN 2023-02-07 19:03:11,576 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e097679fa367eb82dbd32a7d37f4e963, ASSIGN 2023-02-07 19:03:11,577 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1b48fe07f2712b47c4e01783fe6b02a3, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,41593,1675796589353; forceNewPlan=false, retain=false 2023-02-07 19:03:11,577 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3171d9d95a634937d91b9dc1f3b8a8a5, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46143,1675796589311; forceNewPlan=false, retain=false 2023-02-07 19:03:11,577 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4b9640448e0ff51eef07fadfdafd31a5, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,41593,1675796589353; forceNewPlan=false, retain=false 2023-02-07 19:03:11,577 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e097679fa367eb82dbd32a7d37f4e963, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46143,1675796589311; forceNewPlan=false, retain=false 2023-02-07 19:03:11,578 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b60f373395365bab4d169e7de139a9fe, ASSIGN 2023-02-07 19:03:11,578 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=32646fb15d4909afb5300285d9a88228, ASSIGN 2023-02-07 19:03:11,578 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bae1c0d970d6fa537deb42aa4ca65775, ASSIGN 2023-02-07 19:03:11,579 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a60692693abae60624586adf40a8dfce, ASSIGN 2023-02-07 19:03:11,579 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=844d12f763403a7a07be89b8253371cc, ASSIGN 2023-02-07 19:03:11,579 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b60f373395365bab4d169e7de139a9fe, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,41593,1675796589353; forceNewPlan=false, retain=false 2023-02-07 19:03:11,579 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=32646fb15d4909afb5300285d9a88228, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,41593,1675796589353; forceNewPlan=false, retain=false 2023-02-07 19:03:11,580 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bae1c0d970d6fa537deb42aa4ca65775, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46143,1675796589311; forceNewPlan=false, retain=false 2023-02-07 19:03:11,580 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=844d12f763403a7a07be89b8253371cc, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46143,1675796589311; forceNewPlan=false, retain=false 2023-02-07 19:03:11,580 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a60692693abae60624586adf40a8dfce, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,41593,1675796589353; forceNewPlan=false, retain=false 2023-02-07 19:03:11,619 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:11,620 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:11,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:11,725 INFO [jenkins-hbase6:34499] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 19:03:11,730 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3171d9d95a634937d91b9dc1f3b8a8a5, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e097679fa367eb82dbd32a7d37f4e963, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,730 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=49c9390b12f04bdca9455e0385741c4c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,730 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591730"}]},"ts":"1675796591730"} 2023-02-07 19:03:11,730 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=bae1c0d970d6fa537deb42aa4ca65775, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,730 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=844d12f763403a7a07be89b8253371cc, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,730 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591730"}]},"ts":"1675796591730"} 2023-02-07 19:03:11,730 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591730"}]},"ts":"1675796591730"} 2023-02-07 19:03:11,730 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675796591005.844d12f763403a7a07be89b8253371cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591730"}]},"ts":"1675796591730"} 2023-02-07 19:03:11,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591730"}]},"ts":"1675796591730"} 2023-02-07 19:03:11,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 3171d9d95a634937d91b9dc1f3b8a8a5, server=jenkins-hbase6.apache.org,46143,1675796589311}] 2023-02-07 19:03:11,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure bae1c0d970d6fa537deb42aa4ca65775, server=jenkins-hbase6.apache.org,46143,1675796589311}] 2023-02-07 19:03:11,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 49c9390b12f04bdca9455e0385741c4c, server=jenkins-hbase6.apache.org,46143,1675796589311}] 2023-02-07 19:03:11,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure 844d12f763403a7a07be89b8253371cc, server=jenkins-hbase6.apache.org,46143,1675796589311}] 2023-02-07 19:03:11,739 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1b48fe07f2712b47c4e01783fe6b02a3, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,739 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591739"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591739"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591739"}]},"ts":"1675796591739"} 2023-02-07 19:03:11,740 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b60f373395365bab4d169e7de139a9fe, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,740 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796591740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591740"}]},"ts":"1675796591740"} 2023-02-07 19:03:11,741 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=32646fb15d4909afb5300285d9a88228, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,741 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591741"}]},"ts":"1675796591741"} 2023-02-07 19:03:11,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure e097679fa367eb82dbd32a7d37f4e963, server=jenkins-hbase6.apache.org,46143,1675796589311}] 2023-02-07 19:03:11,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 1b48fe07f2712b47c4e01783fe6b02a3, server=jenkins-hbase6.apache.org,41593,1675796589353}] 2023-02-07 19:03:11,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure b60f373395365bab4d169e7de139a9fe, server=jenkins-hbase6.apache.org,41593,1675796589353}] 2023-02-07 19:03:11,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 32646fb15d4909afb5300285d9a88228, server=jenkins-hbase6.apache.org,41593,1675796589353}] 2023-02-07 19:03:11,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4b9640448e0ff51eef07fadfdafd31a5, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796591746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591746"}]},"ts":"1675796591746"} 2023-02-07 19:03:11,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a60692693abae60624586adf40a8dfce, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675796591005.a60692693abae60624586adf40a8dfce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796591747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796591747"}]},"ts":"1675796591747"} 2023-02-07 19:03:11,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure 4b9640448e0ff51eef07fadfdafd31a5, server=jenkins-hbase6.apache.org,41593,1675796589353}] 2023-02-07 19:03:11,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure a60692693abae60624586adf40a8dfce, server=jenkins-hbase6.apache.org,41593,1675796589353}] 2023-02-07 19:03:11,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bae1c0d970d6fa537deb42aa4ca65775, NAME => 'testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 19:03:11,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,890 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,892 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1 2023-02-07 19:03:11,892 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1 2023-02-07 19:03:11,892 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bae1c0d970d6fa537deb42aa4ca65775 columnFamilyName f1 2023-02-07 19:03:11,893 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(310): Store=bae1c0d970d6fa537deb42aa4ca65775/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,893 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,894 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2 2023-02-07 19:03:11,894 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2 2023-02-07 19:03:11,895 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bae1c0d970d6fa537deb42aa4ca65775 columnFamilyName f2 2023-02-07 19:03:11,895 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(310): Store=bae1c0d970d6fa537deb42aa4ca65775/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:11,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:11,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b48fe07f2712b47c4e01783fe6b02a3, NAME => 'testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 19:03:11,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,905 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:11,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened bae1c0d970d6fa537deb42aa4ca65775; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73383903, jitterRate=0.0935053676366806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:11,906 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1 2023-02-07 19:03:11,906 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1 2023-02-07 19:03:11,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for bae1c0d970d6fa537deb42aa4ca65775: Running coprocessor pre-open hook at 1675796591889Writing region info on filesystem at 1675796591889Initializing all the Stores at 1675796591890 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591890Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591890Cleaning up temporary data from old regions at 1675796591898 (+8 ms)Cleaning up detritus from prior splits at 1675796591899 (+1 ms)Running coprocessor post-open hooks at 1675796591906 (+7 ms)Region opened successfully at 1675796591906 2023-02-07 19:03:11,907 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b48fe07f2712b47c4e01783fe6b02a3 columnFamilyName f1 2023-02-07 19:03:11,907 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(310): Store=1b48fe07f2712b47c4e01783fe6b02a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775., pid=22, masterSystemTime=1675796591884 2023-02-07 19:03:11,907 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,909 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2 2023-02-07 19:03:11,909 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2 2023-02-07 19:03:11,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:11,909 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b48fe07f2712b47c4e01783fe6b02a3 columnFamilyName f2 2023-02-07 19:03:11,910 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=bae1c0d970d6fa537deb42aa4ca65775, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,910 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591910"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796591910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796591910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796591910"}]},"ts":"1675796591910"} 2023-02-07 19:03:11,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,910 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(310): Store=1b48fe07f2712b47c4e01783fe6b02a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 49c9390b12f04bdca9455e0385741c4c, NAME => 'testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 19:03:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-07 19:03:11,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure bae1c0d970d6fa537deb42aa4ca65775, server=jenkins-hbase6.apache.org,46143,1675796589311 in 179 msec 2023-02-07 19:03:11,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:11,915 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bae1c0d970d6fa537deb42aa4ca65775, ASSIGN in 343 msec 2023-02-07 19:03:11,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:11,916 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1 2023-02-07 19:03:11,916 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1 2023-02-07 19:03:11,917 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49c9390b12f04bdca9455e0385741c4c columnFamilyName f1 2023-02-07 19:03:11,917 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(310): Store=49c9390b12f04bdca9455e0385741c4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,917 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:11,920 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2 2023-02-07 19:03:11,920 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2 2023-02-07 19:03:11,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1b48fe07f2712b47c4e01783fe6b02a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70395092, jitterRate=0.048968613147735596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:11,920 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49c9390b12f04bdca9455e0385741c4c columnFamilyName f2 2023-02-07 19:03:11,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1b48fe07f2712b47c4e01783fe6b02a3: Running coprocessor pre-open hook at 1675796591904Writing region info on filesystem at 1675796591904Initializing all the Stores at 1675796591904Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591904Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591904Cleaning up temporary data from old regions at 1675796591913 (+9 ms)Cleaning up detritus from prior splits at 1675796591913Running coprocessor post-open hooks at 1675796591920 (+7 ms)Region opened successfully at 1675796591920 2023-02-07 19:03:11,921 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(310): Store=49c9390b12f04bdca9455e0385741c4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3., pid=26, masterSystemTime=1675796591896 2023-02-07 19:03:11,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:11,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a60692693abae60624586adf40a8dfce, NAME => 'testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 19:03:11,923 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=1b48fe07f2712b47c4e01783fe6b02a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,923 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796591923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796591923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796591923"}]},"ts":"1675796591923"} 2023-02-07 19:03:11,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,925 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-07 19:03:11,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 1b48fe07f2712b47c4e01783fe6b02a3, server=jenkins-hbase6.apache.org,41593,1675796589353 in 183 msec 2023-02-07 19:03:11,927 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1 2023-02-07 19:03:11,927 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1 2023-02-07 19:03:11,927 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60692693abae60624586adf40a8dfce columnFamilyName f1 2023-02-07 19:03:11,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:11,928 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(310): Store=a60692693abae60624586adf40a8dfce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,928 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:11,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1b48fe07f2712b47c4e01783fe6b02a3, ASSIGN in 356 msec 2023-02-07 19:03:11,930 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2 2023-02-07 19:03:11,930 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2 2023-02-07 19:03:11,931 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60692693abae60624586adf40a8dfce columnFamilyName f2 2023-02-07 19:03:11,931 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(310): Store=a60692693abae60624586adf40a8dfce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:11,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 49c9390b12f04bdca9455e0385741c4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68636085, jitterRate=0.02275736629962921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:11,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 49c9390b12f04bdca9455e0385741c4c: Running coprocessor pre-open hook at 1675796591911Writing region info on filesystem at 1675796591911Initializing all the Stores at 1675796591912 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591912Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591915 (+3 ms)Cleaning up temporary data from old regions at 1675796591923 (+8 ms)Cleaning up detritus from prior splits at 1675796591926 (+3 ms)Running coprocessor post-open hooks at 1675796591936 (+10 ms)Region opened successfully at 1675796591936 2023-02-07 19:03:11,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:11,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for a60692693abae60624586adf40a8dfce 2023-02-07 19:03:11,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:11,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened a60692693abae60624586adf40a8dfce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74504697, jitterRate=0.1102064996957779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:11,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for a60692693abae60624586adf40a8dfce: Running coprocessor pre-open hook at 1675796591924Writing region info on filesystem at 1675796591924Initializing all the Stores at 1675796591925 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591925Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591925Cleaning up temporary data from old regions at 1675796591936 (+11 ms)Cleaning up detritus from prior splits at 1675796591937 (+1 ms)Running coprocessor post-open hooks at 1675796591942 (+5 ms)Region opened successfully at 1675796591942 2023-02-07 19:03:11,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce., pid=30, masterSystemTime=1675796591896 2023-02-07 19:03:11,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c., pid=23, masterSystemTime=1675796591884 2023-02-07 19:03:11,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:11,944 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a60692693abae60624586adf40a8dfce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,945 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675796591005.a60692693abae60624586adf40a8dfce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796591944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796591944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796591944"}]},"ts":"1675796591944"} 2023-02-07 19:03:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 32646fb15d4909afb5300285d9a88228, NAME => 'testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 19:03:11,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3171d9d95a634937d91b9dc1f3b8a8a5, NAME => 'testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 19:03:11,945 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=49c9390b12f04bdca9455e0385741c4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,945 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591945"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796591945"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796591945"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796591945"}]},"ts":"1675796591945"} 2023-02-07 19:03:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,948 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,948 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,948 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 19:03:11,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-07 19:03:11,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure a60692693abae60624586adf40a8dfce, server=jenkins-hbase6.apache.org,41593,1675796589353 in 197 msec 2023-02-07 19:03:11,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-07 19:03:11,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 49c9390b12f04bdca9455e0385741c4c, server=jenkins-hbase6.apache.org,46143,1675796589311 in 212 msec 2023-02-07 19:03:11,950 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1 2023-02-07 19:03:11,950 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1 2023-02-07 19:03:11,951 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1 2023-02-07 19:03:11,951 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1 2023-02-07 19:03:11,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a60692693abae60624586adf40a8dfce, ASSIGN in 378 msec 2023-02-07 19:03:11,951 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3171d9d95a634937d91b9dc1f3b8a8a5 columnFamilyName f1 2023-02-07 19:03:11,951 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32646fb15d4909afb5300285d9a88228 columnFamilyName f1 2023-02-07 19:03:11,952 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(310): Store=3171d9d95a634937d91b9dc1f3b8a8a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,952 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(310): Store=32646fb15d4909afb5300285d9a88228/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,952 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=49c9390b12f04bdca9455e0385741c4c, ASSIGN in 379 msec 2023-02-07 19:03:11,952 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,956 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2 2023-02-07 19:03:11,956 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2 2023-02-07 19:03:11,957 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32646fb15d4909afb5300285d9a88228 columnFamilyName f2 2023-02-07 19:03:11,963 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(310): Store=32646fb15d4909afb5300285d9a88228/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,964 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2 2023-02-07 19:03:11,964 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2 2023-02-07 19:03:11,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,965 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3171d9d95a634937d91b9dc1f3b8a8a5 columnFamilyName f2 2023-02-07 19:03:11,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,965 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(310): Store=3171d9d95a634937d91b9dc1f3b8a8a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:11,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:11,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:11,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:11,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:11,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 3171d9d95a634937d91b9dc1f3b8a8a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73519376, jitterRate=0.09552407264709473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:11,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 3171d9d95a634937d91b9dc1f3b8a8a5: Running coprocessor pre-open hook at 1675796591946Writing region info on filesystem at 1675796591946Initializing all the Stores at 1675796591947 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591947Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591948 (+1 ms)Cleaning up temporary data from old regions at 1675796591968 (+20 ms)Cleaning up detritus from prior splits at 1675796591968Running coprocessor post-open hooks at 1675796591980 (+12 ms)Region opened successfully at 1675796591980 2023-02-07 19:03:11,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:11,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 32646fb15d4909afb5300285d9a88228; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62430212, jitterRate=-0.06971734762191772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:11,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5., pid=21, masterSystemTime=1675796591884 2023-02-07 19:03:11,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 32646fb15d4909afb5300285d9a88228: Running coprocessor pre-open hook at 1675796591946Writing region info on filesystem at 1675796591946Initializing all the Stores at 1675796591947 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591947Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591947Cleaning up temporary data from old regions at 1675796591967 (+20 ms)Cleaning up detritus from prior splits at 1675796591968 (+1 ms)Running coprocessor post-open hooks at 1675796591981 (+13 ms)Region opened successfully at 1675796591981 2023-02-07 19:03:11,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228., pid=28, masterSystemTime=1675796591896 2023-02-07 19:03:11,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:11,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 844d12f763403a7a07be89b8253371cc, NAME => 'testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 19:03:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3171d9d95a634937d91b9dc1f3b8a8a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,984 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591984"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796591984"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796591984"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796591984"}]},"ts":"1675796591984"} 2023-02-07 19:03:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:11,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b60f373395365bab4d169e7de139a9fe, NAME => 'testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 19:03:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:11,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=32646fb15d4909afb5300285d9a88228, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:11,986 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796591986"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796591986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796591986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796591986"}]},"ts":"1675796591986"} 2023-02-07 19:03:11,987 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,988 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1 2023-02-07 19:03:11,988 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1 2023-02-07 19:03:11,988 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 844d12f763403a7a07be89b8253371cc columnFamilyName f1 2023-02-07 19:03:11,992 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(310): Store=844d12f763403a7a07be89b8253371cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,992 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,992 DEBUG [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/f1 2023-02-07 19:03:11,993 DEBUG [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/f1 2023-02-07 19:03:11,993 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60f373395365bab4d169e7de139a9fe columnFamilyName f1 2023-02-07 19:03:11,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-07 19:03:11,994 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2 2023-02-07 19:03:11,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 3171d9d95a634937d91b9dc1f3b8a8a5, server=jenkins-hbase6.apache.org,46143,1675796589311 in 256 msec 2023-02-07 19:03:11,994 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2 2023-02-07 19:03:11,994 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(310): Store=b60f373395365bab4d169e7de139a9fe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,994 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:11,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-07 19:03:11,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 32646fb15d4909afb5300285d9a88228, server=jenkins-hbase6.apache.org,41593,1675796589353 in 243 msec 2023-02-07 19:03:11,995 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 844d12f763403a7a07be89b8253371cc columnFamilyName f2 2023-02-07 19:03:11,997 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(310): Store=844d12f763403a7a07be89b8253371cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:11,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3171d9d95a634937d91b9dc1f3b8a8a5, ASSIGN in 423 msec 2023-02-07 19:03:11,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:11,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=32646fb15d4909afb5300285d9a88228, ASSIGN in 424 msec 2023-02-07 19:03:11,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:12,000 DEBUG [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/f2 2023-02-07 19:03:12,000 DEBUG [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/f2 2023-02-07 19:03:12,000 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60f373395365bab4d169e7de139a9fe columnFamilyName f2 2023-02-07 19:03:12,002 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(310): Store=b60f373395365bab4d169e7de139a9fe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:12,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:12,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:12,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:12,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:12,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:12,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:12,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:12,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:12,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 844d12f763403a7a07be89b8253371cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61001599, jitterRate=-0.091005340218544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:12,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened b60f373395365bab4d169e7de139a9fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65008622, jitterRate=-0.03129604458808899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:12,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 844d12f763403a7a07be89b8253371cc: Running coprocessor pre-open hook at 1675796591984Writing region info on filesystem at 1675796591984Initializing all the Stores at 1675796591986 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591986Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591986Cleaning up temporary data from old regions at 1675796592000 (+14 ms)Cleaning up detritus from prior splits at 1675796592002 (+2 ms)Running coprocessor post-open hooks at 1675796592021 (+19 ms)Region opened successfully at 1675796592021 2023-02-07 19:03:12,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for b60f373395365bab4d169e7de139a9fe: Running coprocessor pre-open hook at 1675796591986Writing region info on filesystem at 1675796591986Initializing all the Stores at 1675796591987 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591987Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796591987Cleaning up temporary data from old regions at 1675796592005 (+18 ms)Cleaning up detritus from prior splits at 1675796592006 (+1 ms)Running coprocessor post-open hooks at 1675796592021 (+15 ms)Region opened successfully at 1675796592021 2023-02-07 19:03:12,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc., pid=24, masterSystemTime=1675796591884 2023-02-07 19:03:12,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe., pid=27, masterSystemTime=1675796591896 2023-02-07 19:03:12,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:12,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:12,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:12,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e097679fa367eb82dbd32a7d37f4e963, NAME => 'testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 19:03:12,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:12,026 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=844d12f763403a7a07be89b8253371cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:12,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,026 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675796591005.844d12f763403a7a07be89b8253371cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796592025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796592025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796592025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796592025"}]},"ts":"1675796592025"} 2023-02-07 19:03:12,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:12,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:12,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:12,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4b9640448e0ff51eef07fadfdafd31a5, NAME => 'testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 19:03:12,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:12,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,054 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,054 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,073 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b60f373395365bab4d169e7de139a9fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:12,074 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796592073"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796592073"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796592073"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796592073"}]},"ts":"1675796592073"} 2023-02-07 19:03:12,077 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1 2023-02-07 19:03:12,077 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1 2023-02-07 19:03:12,077 DEBUG [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/f1 2023-02-07 19:03:12,077 DEBUG [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/f1 2023-02-07 19:03:12,077 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e097679fa367eb82dbd32a7d37f4e963 columnFamilyName f1 2023-02-07 19:03:12,078 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b9640448e0ff51eef07fadfdafd31a5 columnFamilyName f1 2023-02-07 19:03:12,078 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(310): Store=4b9640448e0ff51eef07fadfdafd31a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:12,078 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,080 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(310): Store=e097679fa367eb82dbd32a7d37f4e963/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:12,080 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,080 DEBUG [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/f2 2023-02-07 19:03:12,080 DEBUG [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/f2 2023-02-07 19:03:12,081 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b9640448e0ff51eef07fadfdafd31a5 columnFamilyName f2 2023-02-07 19:03:12,095 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2 2023-02-07 19:03:12,095 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2 2023-02-07 19:03:12,095 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(310): Store=4b9640448e0ff51eef07fadfdafd31a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:12,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-07 19:03:12,096 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e097679fa367eb82dbd32a7d37f4e963 columnFamilyName f2 2023-02-07 19:03:12,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure 844d12f763403a7a07be89b8253371cc, server=jenkins-hbase6.apache.org,46143,1675796589311 in 301 msec 2023-02-07 19:03:12,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,097 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(310): Store=e097679fa367eb82dbd32a7d37f4e963/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:12,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=844d12f763403a7a07be89b8253371cc, ASSIGN in 524 msec 2023-02-07 19:03:12,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-07 19:03:12,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure b60f373395365bab4d169e7de139a9fe, server=jenkins-hbase6.apache.org,41593,1675796589353 in 335 msec 2023-02-07 19:03:12,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b60f373395365bab4d169e7de139a9fe, ASSIGN in 526 msec 2023-02-07 19:03:12,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:12,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:12,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:12,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:12,121 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:12,121 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:12,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:12,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 4b9640448e0ff51eef07fadfdafd31a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66857361, jitterRate=-0.003747686743736267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:12,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 4b9640448e0ff51eef07fadfdafd31a5: Running coprocessor pre-open hook at 1675796592027Writing region info on filesystem at 1675796592027Initializing all the Stores at 1675796592039 (+12 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796592039Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796592054 (+15 ms)Cleaning up temporary data from old regions at 1675796592098 (+44 ms)Cleaning up detritus from prior splits at 1675796592099 (+1 ms)Running coprocessor post-open hooks at 1675796592127 (+28 ms)Region opened successfully at 1675796592127 2023-02-07 19:03:12,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:12,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5., pid=29, masterSystemTime=1675796591896 2023-02-07 19:03:12,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened e097679fa367eb82dbd32a7d37f4e963; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67634804, jitterRate=0.007837116718292236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:12,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for e097679fa367eb82dbd32a7d37f4e963: Running coprocessor pre-open hook at 1675796592026Writing region info on filesystem at 1675796592026Initializing all the Stores at 1675796592028 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796592028Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796592039 (+11 ms)Cleaning up temporary data from old regions at 1675796592099 (+60 ms)Cleaning up detritus from prior splits at 1675796592100 (+1 ms)Running coprocessor post-open hooks at 1675796592128 (+28 ms)Region opened successfully at 1675796592128 2023-02-07 19:03:12,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963., pid=25, masterSystemTime=1675796591884 2023-02-07 19:03:12,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:12,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:12,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4b9640448e0ff51eef07fadfdafd31a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:12,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675796592130"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796592130"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796592130"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796592130"}]},"ts":"1675796592130"} 2023-02-07 19:03:12,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:12,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:12,132 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e097679fa367eb82dbd32a7d37f4e963, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:12,132 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675796592132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796592132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796592132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796592132"}]},"ts":"1675796592132"} 2023-02-07 19:03:12,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-07 19:03:12,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure 4b9640448e0ff51eef07fadfdafd31a5, server=jenkins-hbase6.apache.org,41593,1675796589353 in 384 msec 2023-02-07 19:03:12,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-07 19:03:12,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure e097679fa367eb82dbd32a7d37f4e963, server=jenkins-hbase6.apache.org,46143,1675796589311 in 392 msec 2023-02-07 19:03:12,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4b9640448e0ff51eef07fadfdafd31a5, ASSIGN in 564 msec 2023-02-07 19:03:12,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-07 19:03:12,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e097679fa367eb82dbd32a7d37f4e963, ASSIGN in 565 msec 2023-02-07 19:03:12,138 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:12,138 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796592138"}]},"ts":"1675796592138"} 2023-02-07 19:03:12,140 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 19:03:12,142 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:12,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1360 sec 2023-02-07 19:03:13,123 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:13,123 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:13,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:13,125 INFO [Listener at localhost/41793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 19:03:13,125 DEBUG [Listener at localhost/41793] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 19:03:13,125 INFO [Listener at localhost/41793] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:13,129 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 19:03:13,129 INFO [Listener at localhost/41793] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:13,130 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 19:03:13,130 INFO [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:03:13,184 DEBUG [hconnection-0x30448096-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:13,197 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43906, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:13,198 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41593] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:13,206 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46143] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:13,296 INFO [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:03:13,296 INFO [Listener at localhost/41793] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:03:13,297 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:13,297 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:13,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:03:13,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796593300 (current time:1675796593300). 2023-02-07 19:03:13,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:03:13,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] zookeeper.ReadOnlyZKClient(139): Connect 0x38a07340 to 127.0.0.1:53592 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:13,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f24ec4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:13,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:13,310 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:13,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38a07340 to 127.0.0.1:53592 2023-02-07 19:03:13,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:13,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:03:13,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:03:13,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:03:13,315 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:03:13,315 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675797193315 2023-02-07 19:03:13,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:03:13,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 19:03:13,316 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:13,317 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:03:13,317 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:03:13,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:13,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-07 19:03:13,319 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:13,319 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675797193319 2023-02-07 19:03:13,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,334 INFO [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-07 19:03:13,335 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:13,335 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-07 19:03:13,335 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-07 19:03:13,336 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,336 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,339 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:13,339 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:13,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:13,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:13,339 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,339 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,339 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,340 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,340 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 19:03:13,340 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-07 19:03:13,340 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:13,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,341 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-07 19:03:13,341 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-07 19:03:13,341 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46143,1675796589311' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-07 19:03:13,341 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-07 19:03:13,341 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:13,342 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-07 19:03:13,342 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-07 19:03:13,342 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,41593,1675796589353' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-07 19:03:13,344 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,344 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:13,345 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,345 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,345 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,345 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:13,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:13,345 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,345 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:13,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:13,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:13,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46143,1675796589311' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-07 19:03:13,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23ab33c3[Count = 1] remaining members to acquire global barrier 2023-02-07 19:03:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:13,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:13,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,41593,1675796589353' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-07 19:03:13,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23ab33c3[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:13,349 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-07 19:03:13,349 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,351 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-07 19:03:13,351 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,351 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-07 19:03:13,351 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,351 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:13,352 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:13,352 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. started... 2023-02-07 19:03:13,352 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:13,352 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. started... 2023-02-07 19:03:13,353 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 19:03:13,353 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:13,353 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:13,354 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 19:03:13,354 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:13,353 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 49c9390b12f04bdca9455e0385741c4c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 19:03:13,352 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:13,354 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. started... 2023-02-07 19:03:13,354 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:13,354 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1b48fe07f2712b47c4e01783fe6b02a3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:13,354 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. started... 2023-02-07 19:03:13,353 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:13,355 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. started... 2023-02-07 19:03:13,359 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b60f373395365bab4d169e7de139a9fe: 2023-02-07 19:03:13,359 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. started... 2023-02-07 19:03:13,359 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 844d12f763403a7a07be89b8253371cc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:13,360 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 32646fb15d4909afb5300285d9a88228 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 19:03:13,359 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3171d9d95a634937d91b9dc1f3b8a8a5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:13,362 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,362 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,362 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:13,362 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:13,414 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f1/98c68ce6f8ad42989e4a7e867067c6ab 2023-02-07 19:03:13,417 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:13,417 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:13,418 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:13,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:13,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:13,420 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:03:13,430 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. completed. 2023-02-07 19:03:13,430 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:13,431 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:13,431 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 19:03:13,431 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. started... 2023-02-07 19:03:13,437 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4b9640448e0ff51eef07fadfdafd31a5: 2023-02-07 19:03:13,437 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f1/8285a3bfb7094864a00defd19c5c8a2f 2023-02-07 19:03:13,438 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,438 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,438 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:13,438 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:13,451 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f1/0c82ae790cbb42ecb3a7609486c1dee1 2023-02-07 19:03:13,452 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f1/c6c55b40f86f4f13b842e7f44a24b63f 2023-02-07 19:03:13,459 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f1/213ed8407bd642c3b23234340113507e 2023-02-07 19:03:13,482 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f2/2f196bf2fca04a018552f92310af1d52 2023-02-07 19:03:13,495 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f1/98c68ce6f8ad42989e4a7e867067c6ab as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/98c68ce6f8ad42989e4a7e867067c6ab 2023-02-07 19:03:13,500 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/98c68ce6f8ad42989e4a7e867067c6ab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,501 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f2/2f196bf2fca04a018552f92310af1d52 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/2f196bf2fca04a018552f92310af1d52 2023-02-07 19:03:13,511 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. completed. 2023-02-07 19:03:13,511 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:13,511 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:13,511 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 19:03:13,511 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. started... 2023-02-07 19:03:13,511 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a60692693abae60624586adf40a8dfce 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:13,515 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f2/6368a3ee56f041aa9179613dbc16402c 2023-02-07 19:03:13,522 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f2/d38cb704709c459987e9a7c282fd5b54 2023-02-07 19:03:13,533 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/2f196bf2fca04a018552f92310af1d52, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,534 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f1/8285a3bfb7094864a00defd19c5c8a2f as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/8285a3bfb7094864a00defd19c5c8a2f 2023-02-07 19:03:13,535 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1b48fe07f2712b47c4e01783fe6b02a3 in 181ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,535 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 19:03:13,535 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1b48fe07f2712b47c4e01783fe6b02a3: 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/98c68ce6f8ad42989e4a7e867067c6ab] hfiles 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/98c68ce6f8ad42989e4a7e867067c6ab for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/2f196bf2fca04a018552f92310af1d52] hfiles 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/2f196bf2fca04a018552f92310af1d52 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,536 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f1/0c82ae790cbb42ecb3a7609486c1dee1 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/0c82ae790cbb42ecb3a7609486c1dee1 2023-02-07 19:03:13,541 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/8285a3bfb7094864a00defd19c5c8a2f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:13,543 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/0c82ae790cbb42ecb3a7609486c1dee1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,543 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f2/d38cb704709c459987e9a7c282fd5b54 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/d38cb704709c459987e9a7c282fd5b54 2023-02-07 19:03:13,544 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f2/6368a3ee56f041aa9179613dbc16402c as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/6368a3ee56f041aa9179613dbc16402c 2023-02-07 19:03:13,547 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f2/917a2e5af4644d6f9d8206edc3d5d5e4 2023-02-07 19:03:13,549 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/d38cb704709c459987e9a7c282fd5b54, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:13,550 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/6368a3ee56f041aa9179613dbc16402c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,550 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 49c9390b12f04bdca9455e0385741c4c in 197ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,551 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3171d9d95a634937d91b9dc1f3b8a8a5 in 192ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,555 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 49c9390b12f04bdca9455e0385741c4c: 2023-02-07 19:03:13,555 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3171d9d95a634937d91b9dc1f3b8a8a5: 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/8285a3bfb7094864a00defd19c5c8a2f] hfiles 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/8285a3bfb7094864a00defd19c5c8a2f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/0c82ae790cbb42ecb3a7609486c1dee1] hfiles 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/d38cb704709c459987e9a7c282fd5b54] hfiles 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/d38cb704709c459987e9a7c282fd5b54 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/0c82ae790cbb42ecb3a7609486c1dee1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/6368a3ee56f041aa9179613dbc16402c] hfiles 2023-02-07 19:03:13,556 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/6368a3ee56f041aa9179613dbc16402c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,567 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f2/41a8b8deaeab48fb8abfec98bb00f511 2023-02-07 19:03:13,567 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f1/dfc8fc631c2e47b280cd58b2a922f23a 2023-02-07 19:03:13,567 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f1/c6c55b40f86f4f13b842e7f44a24b63f as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/c6c55b40f86f4f13b842e7f44a24b63f 2023-02-07 19:03:13,574 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f1/213ed8407bd642c3b23234340113507e as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/213ed8407bd642c3b23234340113507e 2023-02-07 19:03:13,580 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/213ed8407bd642c3b23234340113507e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:13,580 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f2/41a8b8deaeab48fb8abfec98bb00f511 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/41a8b8deaeab48fb8abfec98bb00f511 2023-02-07 19:03:13,582 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. completed. 2023-02-07 19:03:13,582 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:13,583 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 19:03:13,586 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. completed. 2023-02-07 19:03:13,586 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:13,586 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:13,586 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 19:03:13,586 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. started... 2023-02-07 19:03:13,586 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bae1c0d970d6fa537deb42aa4ca65775 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:13,591 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. completed. 2023-02-07 19:03:13,591 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:13,592 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:13,592 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 19:03:13,592 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. started... 2023-02-07 19:03:13,592 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e097679fa367eb82dbd32a7d37f4e963 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:13,593 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/41a8b8deaeab48fb8abfec98bb00f511, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:13,593 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 32646fb15d4909afb5300285d9a88228 in 233ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 32646fb15d4909afb5300285d9a88228: 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/213ed8407bd642c3b23234340113507e] hfiles 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/213ed8407bd642c3b23234340113507e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/41a8b8deaeab48fb8abfec98bb00f511] hfiles 2023-02-07 19:03:13,594 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/41a8b8deaeab48fb8abfec98bb00f511 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,595 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/c6c55b40f86f4f13b842e7f44a24b63f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,596 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f2/917a2e5af4644d6f9d8206edc3d5d5e4 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/917a2e5af4644d6f9d8206edc3d5d5e4 2023-02-07 19:03:13,608 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f1/c84d45fcbc5d4085b9feead9706417d8 2023-02-07 19:03:13,611 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f2/f273bc33a81c46d18bbac258d731d2cf 2023-02-07 19:03:13,620 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:13,620 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:13,620 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:13,622 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/917a2e5af4644d6f9d8206edc3d5d5e4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:13,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:13,623 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f1/dfc8fc631c2e47b280cd58b2a922f23a as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/dfc8fc631c2e47b280cd58b2a922f23a 2023-02-07 19:03:13,624 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 19:03:13,625 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 844d12f763403a7a07be89b8253371cc in 266ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 844d12f763403a7a07be89b8253371cc: 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/c6c55b40f86f4f13b842e7f44a24b63f] hfiles 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/c6c55b40f86f4f13b842e7f44a24b63f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/917a2e5af4644d6f9d8206edc3d5d5e4] hfiles 2023-02-07 19:03:13,625 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/917a2e5af4644d6f9d8206edc3d5d5e4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,628 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f1/17f7d5e2d7cc46d4844e56280af889ea 2023-02-07 19:03:13,630 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/dfc8fc631c2e47b280cd58b2a922f23a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,631 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f2/f273bc33a81c46d18bbac258d731d2cf as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/f273bc33a81c46d18bbac258d731d2cf 2023-02-07 19:03:13,638 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. completed. 2023-02-07 19:03:13,639 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:13,639 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 19:03:13,640 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/f273bc33a81c46d18bbac258d731d2cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,641 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a60692693abae60624586adf40a8dfce in 130ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a60692693abae60624586adf40a8dfce: 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/dfc8fc631c2e47b280cd58b2a922f23a] hfiles 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/dfc8fc631c2e47b280cd58b2a922f23a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/f273bc33a81c46d18bbac258d731d2cf] hfiles 2023-02-07 19:03:13,642 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/f273bc33a81c46d18bbac258d731d2cf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,654 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. completed. 2023-02-07 19:03:13,655 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:13,655 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 19:03:13,659 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f2/49278a87ecd9408db9aa18fbf9c0cec8 2023-02-07 19:03:13,667 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f1/c84d45fcbc5d4085b9feead9706417d8 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/c84d45fcbc5d4085b9feead9706417d8 2023-02-07 19:03:13,672 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/c84d45fcbc5d4085b9feead9706417d8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,673 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f2/49278a87ecd9408db9aa18fbf9c0cec8 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/49278a87ecd9408db9aa18fbf9c0cec8 2023-02-07 19:03:13,674 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. completed. 2023-02-07 19:03:13,675 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:13,675 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 19:03:13,675 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 19:03:13,675 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,675 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-07 19:03:13,675 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase6.apache.org,41593,1675796589353' in zk 2023-02-07 19:03:13,678 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,678 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-07 19:03:13,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:13,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:13,678 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:13,678 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-07 19:03:13,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:13,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,682 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/49278a87ecd9408db9aa18fbf9c0cec8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,683 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f2/7ace7bb01437444da6e0dd2324884364 2023-02-07 19:03:13,683 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bae1c0d970d6fa537deb42aa4ca65775 in 97ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase6.apache.org,41593,1675796589353': 2023-02-07 19:03:13,683 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bae1c0d970d6fa537deb42aa4ca65775: 2023-02-07 19:03:13,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,41593,1675796589353' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 19:03:13,683 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,684 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,684 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/c84d45fcbc5d4085b9feead9706417d8] hfiles 2023-02-07 19:03:13,684 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/c84d45fcbc5d4085b9feead9706417d8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,684 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/49278a87ecd9408db9aa18fbf9c0cec8] hfiles 2023-02-07 19:03:13,684 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/49278a87ecd9408db9aa18fbf9c0cec8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,689 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f1/17f7d5e2d7cc46d4844e56280af889ea as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/17f7d5e2d7cc46d4844e56280af889ea 2023-02-07 19:03:13,695 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/17f7d5e2d7cc46d4844e56280af889ea, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,696 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f2/7ace7bb01437444da6e0dd2324884364 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/7ace7bb01437444da6e0dd2324884364 2023-02-07 19:03:13,698 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. completed. 2023-02-07 19:03:13,698 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:13,698 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 19:03:13,702 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/7ace7bb01437444da6e0dd2324884364, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:13,703 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e097679fa367eb82dbd32a7d37f4e963 in 111ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:13,703 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e097679fa367eb82dbd32a7d37f4e963: 2023-02-07 19:03:13,704 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,704 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:13,704 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/17f7d5e2d7cc46d4844e56280af889ea] hfiles 2023-02-07 19:03:13,704 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/17f7d5e2d7cc46d4844e56280af889ea for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,704 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/7ace7bb01437444da6e0dd2324884364] hfiles 2023-02-07 19:03:13,704 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/7ace7bb01437444da6e0dd2324884364 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,712 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. completed. 2023-02-07 19:03:13,712 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:13,712 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 19:03:13,712 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 19:03:13,712 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,712 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-07 19:03:13,712 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase6.apache.org,46143,1675796589311' in zk 2023-02-07 19:03:13,714 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-07 19:03:13,714 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,714 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:13,714 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-07 19:03:13,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:13,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:13,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:13,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:13,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase6.apache.org,46143,1675796589311': 2023-02-07 19:03:13,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46143,1675796589311' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:13,719 INFO [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-07 19:03:13,719 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:13,719 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:13,719 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,719 INFO [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:13,722 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:13,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:13,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:13,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:13,723 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,723 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:13,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,725 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:13,725 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,737 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,737 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:13,738 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:13,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:13,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:13,738 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,738 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:13,738 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:13,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,738 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:13,738 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:13,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:13,738 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:13,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:13,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:13,739 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:13,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,740 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,740 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:13,740 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,740 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-07 19:03:13,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,806 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:13,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675796593316Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675796593738 (+422 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675796593740 (+2 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675796593753 (+13 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675796593769 (+16 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675796593805 (+36 ms) 2023-02-07 19:03:13,808 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:13,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 492 msec 2023-02-07 19:03:13,925 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:13,925 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:13,925 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:13,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:13,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:13,927 INFO [Listener at localhost/41793] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:14,123 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:14,123 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:14,130 INFO [Listener at localhost/41793] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:14,139 INFO [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:14,173 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41593] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,182 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46143] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,275 INFO [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:14,279 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:14,279 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:14,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:14,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 19:03:14,285 INFO [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 19:03:14,285 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:14,286 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 19:03:14,286 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 19:03:14,286 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,287 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,288 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:14,288 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:14,288 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:14,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:14,289 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,289 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,290 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,290 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 19:03:14,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 19:03:14,294 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 19:03:14,294 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:14,295 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 19:03:14,295 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 19:03:14,295 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:14,296 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 19:03:14,296 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,296 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. started... 2023-02-07 19:03:14,296 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,296 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. started... 2023-02-07 19:03:14,296 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 49c9390b12f04bdca9455e0385741c4c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 19:03:14,297 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3171d9d95a634937d91b9dc1f3b8a8a5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:14,298 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,298 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. started... 2023-02-07 19:03:14,299 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b48fe07f2712b47c4e01783fe6b02a3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:14,302 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 19:03:14,311 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,312 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 19:03:14,312 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:14,312 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,312 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. started... 2023-02-07 19:03:14,313 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 32646fb15d4909afb5300285d9a88228 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 19:03:14,302 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. started... 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b60f373395365bab4d169e7de139a9fe: 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. started... 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4b9640448e0ff51eef07fadfdafd31a5: 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,314 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. started... 2023-02-07 19:03:14,314 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a60692693abae60624586adf40a8dfce 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:14,312 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. started... 2023-02-07 19:03:14,315 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 844d12f763403a7a07be89b8253371cc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:14,312 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:14,314 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 19:03:14,315 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 19:03:14,343 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f1/c736b524057d4bbaab606cab1185d4e3 2023-02-07 19:03:14,363 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f1/90d01db837594822b5cefc594dc48e22 2023-02-07 19:03:14,382 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f1/28a7cb629fb445b8985164328f5c755c 2023-02-07 19:03:14,382 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f1/0f8cc8d7a88843b7ad05778ec1441aa7 2023-02-07 19:03:14,382 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f1/18769be4afa4442bbcdc09f0b69a3558 2023-02-07 19:03:14,382 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f1/980b2366e0d6454c96c2b4c5ed085e36 2023-02-07 19:03:14,411 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f2/30c1183c8d9a45a89a9c566ec95b5fba 2023-02-07 19:03:14,417 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f1/c736b524057d4bbaab606cab1185d4e3 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/c736b524057d4bbaab606cab1185d4e3 2023-02-07 19:03:14,423 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/c736b524057d4bbaab606cab1185d4e3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:14,423 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/.tmp/f2/30c1183c8d9a45a89a9c566ec95b5fba as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/30c1183c8d9a45a89a9c566ec95b5fba 2023-02-07 19:03:14,428 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/30c1183c8d9a45a89a9c566ec95b5fba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:14,429 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 49c9390b12f04bdca9455e0385741c4c in 133ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,429 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 49c9390b12f04bdca9455e0385741c4c: 2023-02-07 19:03:14,429 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,431 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f2/235f560905b847a8b47dc04a04340bed 2023-02-07 19:03:14,431 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 19:03:14,431 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,431 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. started... 2023-02-07 19:03:14,431 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bae1c0d970d6fa537deb42aa4ca65775 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:14,437 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f1/90d01db837594822b5cefc594dc48e22 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/90d01db837594822b5cefc594dc48e22 2023-02-07 19:03:14,439 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f2/2590c34afe74417ab7dc31e4881811de 2023-02-07 19:03:14,445 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/90d01db837594822b5cefc594dc48e22, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,447 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/.tmp/f2/235f560905b847a8b47dc04a04340bed as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/235f560905b847a8b47dc04a04340bed 2023-02-07 19:03:14,448 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f1/980b2366e0d6454c96c2b4c5ed085e36 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/980b2366e0d6454c96c2b4c5ed085e36 2023-02-07 19:03:14,452 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/235f560905b847a8b47dc04a04340bed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,452 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/980b2366e0d6454c96c2b4c5ed085e36, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,453 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1b48fe07f2712b47c4e01783fe6b02a3 in 154ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,453 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b48fe07f2712b47c4e01783fe6b02a3: 2023-02-07 19:03:14,453 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,453 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/.tmp/f2/2590c34afe74417ab7dc31e4881811de as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/2590c34afe74417ab7dc31e4881811de 2023-02-07 19:03:14,453 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 19:03:14,454 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f2/c7816661f51e47e78feb700e33ec54f1 2023-02-07 19:03:14,458 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f2/45a771a1098e43ef9566755f0a0e00ae 2023-02-07 19:03:14,459 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f2/32956ca4b9714e8cb4723ca85227bc50 2023-02-07 19:03:14,461 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/2590c34afe74417ab7dc31e4881811de, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,462 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a60692693abae60624586adf40a8dfce in 148ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,462 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a60692693abae60624586adf40a8dfce: 2023-02-07 19:03:14,462 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,462 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 19:03:14,462 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f1/28a7cb629fb445b8985164328f5c755c as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/28a7cb629fb445b8985164328f5c755c 2023-02-07 19:03:14,466 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f1/0f8cc8d7a88843b7ad05778ec1441aa7 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/0f8cc8d7a88843b7ad05778ec1441aa7 2023-02-07 19:03:14,468 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/28a7cb629fb445b8985164328f5c755c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,469 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/.tmp/f2/c7816661f51e47e78feb700e33ec54f1 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/c7816661f51e47e78feb700e33ec54f1 2023-02-07 19:03:14,474 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f1/18769be4afa4442bbcdc09f0b69a3558 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/18769be4afa4442bbcdc09f0b69a3558 2023-02-07 19:03:14,475 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/0f8cc8d7a88843b7ad05778ec1441aa7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,476 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/.tmp/f2/45a771a1098e43ef9566755f0a0e00ae as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/45a771a1098e43ef9566755f0a0e00ae 2023-02-07 19:03:14,477 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/c7816661f51e47e78feb700e33ec54f1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,478 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 844d12f763403a7a07be89b8253371cc in 163ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,478 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 844d12f763403a7a07be89b8253371cc: 2023-02-07 19:03:14,478 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,479 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,479 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. started... 2023-02-07 19:03:14,479 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e097679fa367eb82dbd32a7d37f4e963 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:14,479 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 19:03:14,482 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/45a771a1098e43ef9566755f0a0e00ae, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,483 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3171d9d95a634937d91b9dc1f3b8a8a5 in 186ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,483 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3171d9d95a634937d91b9dc1f3b8a8a5: 2023-02-07 19:03:14,483 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,483 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 19:03:14,491 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f1/db04469b2def4d53a0fabfa25aae8f5e 2023-02-07 19:03:14,495 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/18769be4afa4442bbcdc09f0b69a3558, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:14,496 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/.tmp/f2/32956ca4b9714e8cb4723ca85227bc50 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/32956ca4b9714e8cb4723ca85227bc50 2023-02-07 19:03:14,507 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/32956ca4b9714e8cb4723ca85227bc50, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:14,508 INFO [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 32646fb15d4909afb5300285d9a88228 in 196ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,508 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 32646fb15d4909afb5300285d9a88228: 2023-02-07 19:03:14,508 DEBUG [rs(jenkins-hbase6.apache.org,41593,1675796589353)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,508 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 19:03:14,508 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 19:03:14,508 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,518 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 19:03:14,519 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f1/2bacb8c8a5b54c329acab42734549425 2023-02-07 19:03:14,519 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,41593,1675796589353' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 19:03:14,522 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,522 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:14,523 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,523 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:14,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,41593,1675796589353' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 19:03:14,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2794b36e[Count = 1] remaining members to acquire global barrier 2023-02-07 19:03:14,534 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f2/5036d307eee247fdb5e7e1452ef9060a 2023-02-07 19:03:14,541 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f1/db04469b2def4d53a0fabfa25aae8f5e as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/db04469b2def4d53a0fabfa25aae8f5e 2023-02-07 19:03:14,546 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/db04469b2def4d53a0fabfa25aae8f5e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,547 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/.tmp/f2/5036d307eee247fdb5e7e1452ef9060a as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/5036d307eee247fdb5e7e1452ef9060a 2023-02-07 19:03:14,552 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/5036d307eee247fdb5e7e1452ef9060a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,553 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bae1c0d970d6fa537deb42aa4ca65775 in 122ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,553 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bae1c0d970d6fa537deb42aa4ca65775: 2023-02-07 19:03:14,553 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,553 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 19:03:14,557 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f2/dcb6470636434401a7dc81f42ade7021 2023-02-07 19:03:14,562 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f1/2bacb8c8a5b54c329acab42734549425 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/2bacb8c8a5b54c329acab42734549425 2023-02-07 19:03:14,566 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/2bacb8c8a5b54c329acab42734549425, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,567 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/.tmp/f2/dcb6470636434401a7dc81f42ade7021 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/dcb6470636434401a7dc81f42ade7021 2023-02-07 19:03:14,571 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/dcb6470636434401a7dc81f42ade7021, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:14,572 INFO [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e097679fa367eb82dbd32a7d37f4e963 in 93ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:14,573 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e097679fa367eb82dbd32a7d37f4e963: 2023-02-07 19:03:14,573 DEBUG [rs(jenkins-hbase6.apache.org,46143,1675796589311)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,573 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 19:03:14,573 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 19:03:14,573 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,573 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 19:03:14,573 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46143,1675796589311' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 19:03:14,575 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,575 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:14,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:14,576 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,576 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:14,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:14,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46143,1675796589311' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 19:03:14,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2794b36e[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:14,577 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 19:03:14,577 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,580 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 19:03:14,580 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 19:03:14,580 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 19:03:14,580 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 19:03:14,580 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,41593,1675796589353' in zk 2023-02-07 19:03:14,580 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,580 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,46143,1675796589311' in zk 2023-02-07 19:03:14,581 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,581 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:14,582 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 19:03:14,582 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,582 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:14,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:14,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:14,582 DEBUG [member: 'jenkins-hbase6.apache.org,41593,1675796589353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 19:03:14,583 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 19:03:14,583 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:14,583 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,583 DEBUG [member: 'jenkins-hbase6.apache.org,46143,1675796589311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 19:03:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:14,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,41593,1675796589353': 2023-02-07 19:03:14,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,41593,1675796589353' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-07 19:03:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,46143,1675796589311': 2023-02-07 19:03:14,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46143,1675796589311' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 19:03:14,589 INFO [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 19:03:14,589 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:14,589 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:14,589 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 19:03:14,589 INFO [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:14,591 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,591 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:14,591 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,592 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:14,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:14,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:14,592 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,594 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,594 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:14,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:14,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:14,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:14,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:14,599 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,599 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,599 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,599 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:14,599 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:14,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 19:03:14,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:14,598 DEBUG [(jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:14,598 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:14,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:14,600 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:14,600 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:14,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:14,700 DEBUG [Listener at localhost/41793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:14,700 INFO [Listener at localhost/41793] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:14,700 INFO [Listener at localhost/41793] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:14,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34499] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:14,702 INFO [Listener at localhost/41793] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:14,703 DEBUG [Listener at localhost/41793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05c506c3 to 127.0.0.1:53592 2023-02-07 19:03:14,703 DEBUG [Listener at localhost/41793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,703 DEBUG [Listener at localhost/41793] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:14,703 DEBUG [Listener at localhost/41793] util.JVMClusterUtil(257): Found active master hash=397971483, stopped=false 2023-02-07 19:03:14,703 INFO [Listener at localhost/41793] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:14,706 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:14,706 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:14,706 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:14,706 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:14,706 INFO [Listener at localhost/41793] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:14,707 DEBUG [Listener at localhost/41793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dd626ca to 127.0.0.1:53592 2023-02-07 19:03:14,708 DEBUG [Listener at localhost/41793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:14,708 INFO [Listener at localhost/41793] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,46143,1675796589311' ***** 2023-02-07 19:03:14,708 INFO [Listener at localhost/41793] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:14,708 INFO [Listener at localhost/41793] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,41593,1675796589353' ***** 2023-02-07 19:03:14,708 INFO [Listener at localhost/41793] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:14,708 INFO [RS:1;jenkins-hbase6:41593] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:14,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:14,708 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:14,708 INFO [RS:1;jenkins-hbase6:41593] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:14,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:14,708 INFO [RS:0;jenkins-hbase6:46143] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:14,709 INFO [RS:1;jenkins-hbase6:41593] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:14,710 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:14,710 INFO [RS:0;jenkins-hbase6:46143] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:14,710 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(3304): Received CLOSE for 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:14,710 INFO [RS:0;jenkins-hbase6:46143] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:14,711 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(3304): Received CLOSE for f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:14,711 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(3304): Received CLOSE for b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:14,711 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(3304): Received CLOSE for 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1b48fe07f2712b47c4e01783fe6b02a3, disabling compactions & flushes 2023-02-07 19:03:14,711 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(3304): Received CLOSE for 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:14,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,711 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(3304): Received CLOSE for 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:14,711 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(3304): Received CLOSE for 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:14,711 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(3304): Received CLOSE for 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:14,711 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(3304): Received CLOSE for a60692693abae60624586adf40a8dfce 2023-02-07 19:03:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,711 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. after waiting 0 ms 2023-02-07 19:03:14,711 DEBUG [RS:1;jenkins-hbase6:41593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6537bbbe to 127.0.0.1:53592 2023-02-07 19:03:14,711 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(3304): Received CLOSE for bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing f2297cc7bdc83633ccb0a89bae7b2bff, disabling compactions & flushes 2023-02-07 19:03:14,712 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(3304): Received CLOSE for e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:14,712 DEBUG [RS:1;jenkins-hbase6:41593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,712 INFO [RS:1;jenkins-hbase6:41593] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:14,712 INFO [RS:1;jenkins-hbase6:41593] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:14,712 INFO [RS:1;jenkins-hbase6:41593] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:14,712 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,712 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:14,712 DEBUG [RS:0;jenkins-hbase6:46143] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b1c6c4a to 127.0.0.1:53592 2023-02-07 19:03:14,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:14,712 DEBUG [RS:0;jenkins-hbase6:46143] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,712 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-07 19:03:14,712 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-07 19:03:14,712 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1479): Online Regions={1b48fe07f2712b47c4e01783fe6b02a3=testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3., b60f373395365bab4d169e7de139a9fe=testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe., 32646fb15d4909afb5300285d9a88228=testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228., 1588230740=hbase:meta,,1.1588230740, 4b9640448e0ff51eef07fadfdafd31a5=testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5., a60692693abae60624586adf40a8dfce=testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.} 2023-02-07 19:03:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. after waiting 0 ms 2023-02-07 19:03:14,712 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1479): Online Regions={f2297cc7bdc83633ccb0a89bae7b2bff=hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff., 49c9390b12f04bdca9455e0385741c4c=testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c., 3171d9d95a634937d91b9dc1f3b8a8a5=testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5., 844d12f763403a7a07be89b8253371cc=testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc., bae1c0d970d6fa537deb42aa4ca65775=testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775., e097679fa367eb82dbd32a7d37f4e963=testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.} 2023-02-07 19:03:14,715 DEBUG [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1505): Waiting on 1588230740, 1b48fe07f2712b47c4e01783fe6b02a3, 32646fb15d4909afb5300285d9a88228, 4b9640448e0ff51eef07fadfdafd31a5, a60692693abae60624586adf40a8dfce, b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:14,715 DEBUG [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1505): Waiting on 3171d9d95a634937d91b9dc1f3b8a8a5, 49c9390b12f04bdca9455e0385741c4c, 844d12f763403a7a07be89b8253371cc, bae1c0d970d6fa537deb42aa4ca65775, e097679fa367eb82dbd32a7d37f4e963, f2297cc7bdc83633ccb0a89bae7b2bff 2023-02-07 19:03:14,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:14,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:14,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:14,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:14,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing f2297cc7bdc83633ccb0a89bae7b2bff 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:14,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:14,715 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:14,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-07 19:03:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1b48fe07f2712b47c4e01783fe6b02a3: Waiting for close lock at 1675796594711Running coprocessor pre-close hooks at 1675796594711Disabling compacts and flushes for region at 1675796594711Disabling writes for close at 1675796594711Writing region close event to WAL at 1675796594718 (+7 ms)Running coprocessor post-close hooks at 1675796594722 (+4 ms)Closed at 1675796594723 (+1 ms) 2023-02-07 19:03:14,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:14,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing b60f373395365bab4d169e7de139a9fe, disabling compactions & flushes 2023-02-07 19:03:14,723 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:14,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,724 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:14,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. after waiting 0 ms 2023-02-07 19:03:14,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 19:03:14,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for b60f373395365bab4d169e7de139a9fe: Waiting for close lock at 1675796594723Running coprocessor pre-close hooks at 1675796594723Disabling compacts and flushes for region at 1675796594723Disabling writes for close at 1675796594725 (+2 ms)Writing region close event to WAL at 1675796594725Running coprocessor post-close hooks at 1675796594732 (+7 ms)Closed at 1675796594733 (+1 ms) 2023-02-07 19:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 32646fb15d4909afb5300285d9a88228, disabling compactions & flushes 2023-02-07 19:03:14,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. after waiting 0 ms 2023-02-07 19:03:14,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/.tmp/info/a416fcddb9954efda3023e1e1db18768 2023-02-07 19:03:14,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/.tmp/info/12d5482fe64b45d5929ded9d843311ee 2023-02-07 19:03:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 32646fb15d4909afb5300285d9a88228: Waiting for close lock at 1675796594733Running coprocessor pre-close hooks at 1675796594733Disabling compacts and flushes for region at 1675796594733Disabling writes for close at 1675796594733Writing region close event to WAL at 1675796594740 (+7 ms)Running coprocessor post-close hooks at 1675796594745 (+5 ms)Closed at 1675796594745 2023-02-07 19:03:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/.tmp/info/a416fcddb9954efda3023e1e1db18768 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/info/a416fcddb9954efda3023e1e1db18768 2023-02-07 19:03:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 4b9640448e0ff51eef07fadfdafd31a5, disabling compactions & flushes 2023-02-07 19:03:14,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. after waiting 0 ms 2023-02-07 19:03:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 19:03:14,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 4b9640448e0ff51eef07fadfdafd31a5: Waiting for close lock at 1675796594746Running coprocessor pre-close hooks at 1675796594746Disabling compacts and flushes for region at 1675796594746Disabling writes for close at 1675796594746Writing region close event to WAL at 1675796594746Running coprocessor post-close hooks at 1675796594750 (+4 ms)Closed at 1675796594750 2023-02-07 19:03:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing a60692693abae60624586adf40a8dfce, disabling compactions & flushes 2023-02-07 19:03:14,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. after waiting 0 ms 2023-02-07 19:03:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/info/a416fcddb9954efda3023e1e1db18768, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:14,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f2297cc7bdc83633ccb0a89bae7b2bff in 41ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:14,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 19:03:14,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/.tmp/table/6354530701ef47139245ffc4a049c52e 2023-02-07 19:03:14,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/namespace/f2297cc7bdc83633ccb0a89bae7b2bff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:14,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for a60692693abae60624586adf40a8dfce: Waiting for close lock at 1675796594750Running coprocessor pre-close hooks at 1675796594750Disabling compacts and flushes for region at 1675796594750Disabling writes for close at 1675796594750Writing region close event to WAL at 1675796594766 (+16 ms)Running coprocessor post-close hooks at 1675796594770 (+4 ms)Closed at 1675796594770 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:14,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for f2297cc7bdc83633ccb0a89bae7b2bff: Waiting for close lock at 1675796594711Running coprocessor pre-close hooks at 1675796594711Disabling compacts and flushes for region at 1675796594711Disabling writes for close at 1675796594714 (+3 ms)Obtaining lock to block concurrent updates at 1675796594715 (+1 ms)Preparing flush snapshotting stores in f2297cc7bdc83633ccb0a89bae7b2bff at 1675796594715Finished memstore snapshotting hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796594715Flushing stores of hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. at 1675796594718 (+3 ms)Flushing f2297cc7bdc83633ccb0a89bae7b2bff/info: creating writer at 1675796594718Flushing f2297cc7bdc83633ccb0a89bae7b2bff/info: appending metadata at 1675796594722 (+4 ms)Flushing f2297cc7bdc83633ccb0a89bae7b2bff/info: closing flushed file at 1675796594722Flushing f2297cc7bdc83633ccb0a89bae7b2bff/info: reopening flushed file at 1675796594746 (+24 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f2297cc7bdc83633ccb0a89bae7b2bff in 41ms, sequenceid=6, compaction requested=false at 1675796594756 (+10 ms)Writing region close event to WAL at 1675796594763 (+7 ms)Running coprocessor post-close hooks at 1675796594770 (+7 ms)Closed at 1675796594771 (+1 ms) 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796590402.f2297cc7bdc83633ccb0a89bae7b2bff. 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 49c9390b12f04bdca9455e0385741c4c, disabling compactions & flushes 2023-02-07 19:03:14,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. after waiting 0 ms 2023-02-07 19:03:14,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/.tmp/info/12d5482fe64b45d5929ded9d843311ee as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/info/12d5482fe64b45d5929ded9d843311ee 2023-02-07 19:03:14,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 49c9390b12f04bdca9455e0385741c4c: Waiting for close lock at 1675796594771Running coprocessor pre-close hooks at 1675796594771Disabling compacts and flushes for region at 1675796594771Disabling writes for close at 1675796594771Writing region close event to WAL at 1675796594778 (+7 ms)Running coprocessor post-close hooks at 1675796594782 (+4 ms)Closed at 1675796594782 2023-02-07 19:03:14,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:14,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 3171d9d95a634937d91b9dc1f3b8a8a5, disabling compactions & flushes 2023-02-07 19:03:14,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. after waiting 0 ms 2023-02-07 19:03:14,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/info/12d5482fe64b45d5929ded9d843311ee, entries=110, sequenceid=32, filesize=18.7 K 2023-02-07 19:03:14,785 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/.tmp/table/6354530701ef47139245ffc4a049c52e as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/table/6354530701ef47139245ffc4a049c52e 2023-02-07 19:03:14,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 3171d9d95a634937d91b9dc1f3b8a8a5: Waiting for close lock at 1675796594782Running coprocessor pre-close hooks at 1675796594782Disabling compacts and flushes for region at 1675796594782Disabling writes for close at 1675796594783 (+1 ms)Writing region close event to WAL at 1675796594784 (+1 ms)Running coprocessor post-close hooks at 1675796594788 (+4 ms)Closed at 1675796594789 (+1 ms) 2023-02-07 19:03:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 844d12f763403a7a07be89b8253371cc, disabling compactions & flushes 2023-02-07 19:03:14,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. after waiting 0 ms 2023-02-07 19:03:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/table/6354530701ef47139245ffc4a049c52e, entries=4, sequenceid=32, filesize=4.8 K 2023-02-07 19:03:14,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false 2023-02-07 19:03:14,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 19:03:14,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 844d12f763403a7a07be89b8253371cc: Waiting for close lock at 1675796594789Running coprocessor pre-close hooks at 1675796594789Disabling compacts and flushes for region at 1675796594789Disabling writes for close at 1675796594789Writing region close event to WAL at 1675796594790 (+1 ms)Running coprocessor post-close hooks at 1675796594794 (+4 ms)Closed at 1675796594795 (+1 ms) 2023-02-07 19:03:14,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:14,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing bae1c0d970d6fa537deb42aa4ca65775, disabling compactions & flushes 2023-02-07 19:03:14,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. after waiting 0 ms 2023-02-07 19:03:14,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-07 19:03:14,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:14,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:14,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796594712Running coprocessor pre-close hooks at 1675796594712Disabling compacts and flushes for region at 1675796594712Disabling writes for close at 1675796594715 (+3 ms)Obtaining lock to block concurrent updates at 1675796594715Preparing flush snapshotting stores in 1588230740 at 1675796594715Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675796594717 (+2 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675796594718 (+1 ms)Flushing 1588230740/info: creating writer at 1675796594718Flushing 1588230740/info: appending metadata at 1675796594721 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675796594721Flushing 1588230740/table: creating writer at 1675796594745 (+24 ms)Flushing 1588230740/table: appending metadata at 1675796594747 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796594747Flushing 1588230740/info: reopening flushed file at 1675796594778 (+31 ms)Flushing 1588230740/table: reopening flushed file at 1675796594785 (+7 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false at 1675796594791 (+6 ms)Writing region close event to WAL at 1675796594793 (+2 ms)Running coprocessor post-close hooks at 1675796594797 (+4 ms)Closed at 1675796594797 2023-02-07 19:03:14,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:14,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for bae1c0d970d6fa537deb42aa4ca65775: Waiting for close lock at 1675796594795Running coprocessor pre-close hooks at 1675796594795Disabling compacts and flushes for region at 1675796594795Disabling writes for close at 1675796594796 (+1 ms)Writing region close event to WAL at 1675796594797 (+1 ms)Running coprocessor post-close hooks at 1675796594800 (+3 ms)Closed at 1675796594800 2023-02-07 19:03:14,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:14,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing e097679fa367eb82dbd32a7d37f4e963, disabling compactions & flushes 2023-02-07 19:03:14,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. after waiting 0 ms 2023-02-07 19:03:14,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:14,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for e097679fa367eb82dbd32a7d37f4e963: Waiting for close lock at 1675796594800Running coprocessor pre-close hooks at 1675796594800Disabling compacts and flushes for region at 1675796594800Disabling writes for close at 1675796594800Writing region close event to WAL at 1675796594803 (+3 ms)Running coprocessor post-close hooks at 1675796594807 (+4 ms)Closed at 1675796594807 2023-02-07 19:03:14,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:14,915 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,46143,1675796589311; all regions closed. 2023-02-07 19:03:14,915 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,41593,1675796589353; all regions closed. 2023-02-07 19:03:14,922 DEBUG [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/oldWALs 2023-02-07 19:03:14,922 DEBUG [RS:0;jenkins-hbase6:46143] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/oldWALs 2023-02-07 19:03:14,922 INFO [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C41593%2C1675796589353.meta:.meta(num 1675796590329) 2023-02-07 19:03:14,922 INFO [RS:0;jenkins-hbase6:46143] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46143%2C1675796589311:(num 1675796590810) 2023-02-07 19:03:14,922 DEBUG [RS:0;jenkins-hbase6:46143] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,922 INFO [RS:0;jenkins-hbase6:46143] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:14,922 INFO [RS:0;jenkins-hbase6:46143] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:14,922 INFO [RS:0;jenkins-hbase6:46143] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:14,923 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:14,923 INFO [RS:0;jenkins-hbase6:46143] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:14,923 INFO [RS:0;jenkins-hbase6:46143] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:14,923 INFO [RS:0;jenkins-hbase6:46143] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:46143 2023-02-07 19:03:14,926 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:14,926 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,926 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bb9d5ba rejected from java.util.concurrent.ThreadPoolExecutor@1f864215[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:14,926 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46143,1675796589311 2023-02-07 19:03:14,926 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:14,927 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:14,927 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e55f0b5 rejected from java.util.concurrent.ThreadPoolExecutor@1f864215[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:14,928 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,46143,1675796589311] 2023-02-07 19:03:14,928 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,46143,1675796589311; numProcessing=1 2023-02-07 19:03:14,928 DEBUG [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/oldWALs 2023-02-07 19:03:14,928 INFO [RS:1;jenkins-hbase6:41593] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C41593%2C1675796589353:(num 1675796591117) 2023-02-07 19:03:14,928 DEBUG [RS:1;jenkins-hbase6:41593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,928 INFO [RS:1;jenkins-hbase6:41593] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:14,928 INFO [RS:1;jenkins-hbase6:41593] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:14,928 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:14,929 INFO [RS:1;jenkins-hbase6:41593] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:41593 2023-02-07 19:03:14,931 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,46143,1675796589311 already deleted, retry=false 2023-02-07 19:03:14,931 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,46143,1675796589311 expired; onlineServers=1 2023-02-07 19:03:14,932 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:14,932 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,41593,1675796589353 2023-02-07 19:03:14,932 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1abd63a7 rejected from java.util.concurrent.ThreadPoolExecutor@1e82e428[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:14,933 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,41593,1675796589353] 2023-02-07 19:03:14,933 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,41593,1675796589353; numProcessing=2 2023-02-07 19:03:14,934 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,41593,1675796589353 already deleted, retry=false 2023-02-07 19:03:14,934 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,41593,1675796589353 expired; onlineServers=0 2023-02-07 19:03:14,934 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,34499,1675796589249' ***** 2023-02-07 19:03:14,934 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:14,935 DEBUG [M:0;jenkins-hbase6:34499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56859a20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:14,935 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,34499,1675796589249 2023-02-07 19:03:14,935 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,34499,1675796589249; all regions closed. 2023-02-07 19:03:14,935 DEBUG [M:0;jenkins-hbase6:34499] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:14,935 DEBUG [M:0;jenkins-hbase6:34499] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:14,935 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:14,935 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796589952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796589952,5,FailOnTimeoutGroup] 2023-02-07 19:03:14,935 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796589952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796589952,5,FailOnTimeoutGroup] 2023-02-07 19:03:14,935 DEBUG [M:0;jenkins-hbase6:34499] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:14,936 INFO [M:0;jenkins-hbase6:34499] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:14,937 INFO [M:0;jenkins-hbase6:34499] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:14,937 INFO [M:0;jenkins-hbase6:34499] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:14,937 DEBUG [M:0;jenkins-hbase6:34499] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:14,937 INFO [M:0;jenkins-hbase6:34499] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:14,937 ERROR [M:0;jenkins-hbase6:34499] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 19:03:14,937 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:14,937 INFO [M:0;jenkins-hbase6:34499] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:14,937 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:14,937 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:14,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:14,938 DEBUG [M:0;jenkins-hbase6:34499] zookeeper.ZKUtil(398): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:14,938 WARN [M:0;jenkins-hbase6:34499] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:14,938 INFO [M:0;jenkins-hbase6:34499] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:14,938 INFO [M:0;jenkins-hbase6:34499] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:14,939 DEBUG [M:0;jenkins-hbase6:34499] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:14,939 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:14,939 DEBUG [M:0;jenkins-hbase6:34499] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:14,939 DEBUG [M:0;jenkins-hbase6:34499] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:14,939 DEBUG [M:0;jenkins-hbase6:34499] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:14,939 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-07 19:03:14,948 INFO [M:0;jenkins-hbase6:34499] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3cabea3981bc4ad2b2d7973f50efbcf7 2023-02-07 19:03:14,953 DEBUG [M:0;jenkins-hbase6:34499] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3cabea3981bc4ad2b2d7973f50efbcf7 as hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3cabea3981bc4ad2b2d7973f50efbcf7 2023-02-07 19:03:14,958 INFO [M:0;jenkins-hbase6:34499] regionserver.HStore(1080): Added hdfs://localhost:40767/user/jenkins/test-data/eedbd1ac-c8a3-69b2-86ea-8f3cb7e5036f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3cabea3981bc4ad2b2d7973f50efbcf7, entries=31, sequenceid=218, filesize=9.0 K 2023-02-07 19:03:14,959 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-07 19:03:14,959 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:14,959 DEBUG [M:0;jenkins-hbase6:34499] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796594939Disabling compacts and flushes for region at 1675796594939Disabling writes for close at 1675796594939Obtaining lock to block concurrent updates at 1675796594939Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796594939Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675796594939Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796594940 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796594940Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796594942 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796594943 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796594954 (+11 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false at 1675796594959 (+5 ms)Writing region close event to WAL at 1675796594959Closed at 1675796594959 2023-02-07 19:03:14,963 INFO [M:0;jenkins-hbase6:34499] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:14,963 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:14,964 INFO [M:0;jenkins-hbase6:34499] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:34499 2023-02-07 19:03:14,968 DEBUG [M:0;jenkins-hbase6:34499] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,34499,1675796589249 already deleted, retry=false 2023-02-07 19:03:15,116 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:15,116 INFO [M:0;jenkins-hbase6:34499] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,34499,1675796589249; zookeeper connection closed. 2023-02-07 19:03:15,116 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42c8e1db rejected from java.util.concurrent.ThreadPoolExecutor@46f76d5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:15,117 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): master:34499-0x1013e97dee80000, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:15,117 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@377f83e2 rejected from java.util.concurrent.ThreadPoolExecutor@46f76d5a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:15,216 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:15,216 INFO [RS:1;jenkins-hbase6:41593] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,41593,1675796589353; zookeeper connection closed. 2023-02-07 19:03:15,216 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bc02dfb rejected from java.util.concurrent.ThreadPoolExecutor@1e82e428[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:15,217 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73ee0de5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73ee0de5 2023-02-07 19:03:15,217 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:41593-0x1013e97dee80002, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:15,217 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@633bcfa1 rejected from java.util.concurrent.ThreadPoolExecutor@1e82e428[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:15,316 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:15,316 INFO [RS:0;jenkins-hbase6:46143] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,46143,1675796589311; zookeeper connection closed. 2023-02-07 19:03:15,317 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@462f975d rejected from java.util.concurrent.ThreadPoolExecutor@1f864215[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:15,317 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b664b97] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b664b97 2023-02-07 19:03:15,317 DEBUG [Listener at localhost/41793-EventThread] zookeeper.ZKWatcher(600): regionserver:46143-0x1013e97dee80001, quorum=127.0.0.1:53592, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:15,317 ERROR [Listener at localhost/41793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2beaaf76 rejected from java.util.concurrent.ThreadPoolExecutor@1f864215[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:15,317 INFO [Listener at localhost/41793] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:15,410 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop-6652601798701199084.jar 2023-02-07 19:03:15,414 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675796593300 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:15,415 DEBUG [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce 2023-02-07 19:03:15,415 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:15,415 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:15,415 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:15,415 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:15,415 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:15,415 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: a60692693abae60624586adf40a8dfce 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(239): region to add: e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=1b48fe07f2712b47c4e01783fe6b02a3 as 1b48fe07f2712b47c4e01783fe6b02a3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=b60f373395365bab4d169e7de139a9fe as b60f373395365bab4d169e7de139a9fe in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=32646fb15d4909afb5300285d9a88228 as 32646fb15d4909afb5300285d9a88228 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=844d12f763403a7a07be89b8253371cc as 844d12f763403a7a07be89b8253371cc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=49c9390b12f04bdca9455e0385741c4c as 49c9390b12f04bdca9455e0385741c4c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=3171d9d95a634937d91b9dc1f3b8a8a5 as 3171d9d95a634937d91b9dc1f3b8a8a5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=4b9640448e0ff51eef07fadfdafd31a5 as 4b9640448e0ff51eef07fadfdafd31a5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=a60692693abae60624586adf40a8dfce as a60692693abae60624586adf40a8dfce in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=bae1c0d970d6fa537deb42aa4ca65775 as bae1c0d970d6fa537deb42aa4ca65775 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,416 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(585): clone region=e097679fa367eb82dbd32a7d37f4e963 as e097679fa367eb82dbd32a7d37f4e963 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 19:03:15,418 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1b48fe07f2712b47c4e01783fe6b02a3, NAME => 'testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,418 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => b60f373395365bab4d169e7de139a9fe, NAME => 'testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,419 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 32646fb15d4909afb5300285d9a88228, NAME => 'testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,423 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 4b9640448e0ff51eef07fadfdafd31a5, NAME => 'testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,423 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3171d9d95a634937d91b9dc1f3b8a8a5, NAME => 'testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,424 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 49c9390b12f04bdca9455e0385741c4c, NAME => 'testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,424 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a60692693abae60624586adf40a8dfce, NAME => 'testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,424 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 844d12f763403a7a07be89b8253371cc, NAME => 'testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,451 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,451 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing b60f373395365bab4d169e7de139a9fe, disabling compactions & flushes 2023-02-07 19:03:15,451 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:15,451 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:15,451 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. after waiting 0 ms 2023-02-07 19:03:15,451 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:15,451 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:15,451 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for b60f373395365bab4d169e7de139a9fe: Waiting for close lock at 1675796595451Disabling compacts and flushes for region at 1675796595451Disabling writes for close at 1675796595451Writing region close event to WAL at 1675796595451Closed at 1675796595451 2023-02-07 19:03:15,452 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => bae1c0d970d6fa537deb42aa4ca65775, NAME => 'testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,453 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,453 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98c68ce6f8ad42989e4a7e867067c6ab from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,464 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,464 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,464 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c82ae790cbb42ecb3a7609486c1dee1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,465 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 213ed8407bd642c3b23234340113507e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,467 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,467 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dfc8fc631c2e47b280cd58b2a922f23a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,467 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f196bf2fca04a018552f92310af1d52 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,467 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41a8b8deaeab48fb8abfec98bb00f511 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,471 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,471 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8285a3bfb7094864a00defd19c5c8a2f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,472 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1b48fe07f2712b47c4e01783fe6b02a3, disabling compactions & flushes 2023-02-07 19:03:15,472 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,473 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,473 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. after waiting 0 ms 2023-02-07 19:03:15,473 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,473 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,473 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1b48fe07f2712b47c4e01783fe6b02a3: Waiting for close lock at 1675796595472Disabling compacts and flushes for region at 1675796595472Disabling writes for close at 1675796595473 (+1 ms)Writing region close event to WAL at 1675796595473Closed at 1675796595473 2023-02-07 19:03:15,473 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6368a3ee56f041aa9179613dbc16402c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,473 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e097679fa367eb82dbd32a7d37f4e963, NAME => 'testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,474 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 32646fb15d4909afb5300285d9a88228, disabling compactions & flushes 2023-02-07 19:03:15,475 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,475 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,475 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. after waiting 0 ms 2023-02-07 19:03:15,475 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,475 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,475 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 32646fb15d4909afb5300285d9a88228: Waiting for close lock at 1675796595474Disabling compacts and flushes for region at 1675796595474Disabling writes for close at 1675796595475 (+1 ms)Writing region close event to WAL at 1675796595475Closed at 1675796595475 2023-02-07 19:03:15,482 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f273bc33a81c46d18bbac258d731d2cf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,483 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d38cb704709c459987e9a7c282fd5b54 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,483 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,483 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,483 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c6c55b40f86f4f13b842e7f44a24b63f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,484 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 4b9640448e0ff51eef07fadfdafd31a5, disabling compactions & flushes 2023-02-07 19:03:15,484 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,484 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,484 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. after waiting 0 ms 2023-02-07 19:03:15,484 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,484 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,484 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 4b9640448e0ff51eef07fadfdafd31a5: Waiting for close lock at 1675796595484Disabling compacts and flushes for region at 1675796595484Disabling writes for close at 1675796595484Writing region close event to WAL at 1675796595484Closed at 1675796595484 2023-02-07 19:03:15,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3171d9d95a634937d91b9dc1f3b8a8a5, disabling compactions & flushes 2023-02-07 19:03:15,486 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:15,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:15,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. after waiting 0 ms 2023-02-07 19:03:15,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:15,486 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:15,486 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3171d9d95a634937d91b9dc1f3b8a8a5: Waiting for close lock at 1675796595486Disabling compacts and flushes for region at 1675796595486Disabling writes for close at 1675796595486Writing region close event to WAL at 1675796595486Closed at 1675796595486 2023-02-07 19:03:15,487 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a60692693abae60624586adf40a8dfce, disabling compactions & flushes 2023-02-07 19:03:15,487 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:15,487 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:15,487 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. after waiting 0 ms 2023-02-07 19:03:15,487 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:15,487 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:15,487 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a60692693abae60624586adf40a8dfce: Waiting for close lock at 1675796595487Disabling compacts and flushes for region at 1675796595487Disabling writes for close at 1675796595487Writing region close event to WAL at 1675796595487Closed at 1675796595487 2023-02-07 19:03:15,488 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 917a2e5af4644d6f9d8206edc3d5d5e4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,489 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 49c9390b12f04bdca9455e0385741c4c, disabling compactions & flushes 2023-02-07 19:03:15,489 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:15,489 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:15,489 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. after waiting 0 ms 2023-02-07 19:03:15,489 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:15,489 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:15,489 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 49c9390b12f04bdca9455e0385741c4c: Waiting for close lock at 1675796595489Disabling compacts and flushes for region at 1675796595489Disabling writes for close at 1675796595489Writing region close event to WAL at 1675796595489Closed at 1675796595489 2023-02-07 19:03:15,490 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,490 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c84d45fcbc5d4085b9feead9706417d8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,490 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 844d12f763403a7a07be89b8253371cc, disabling compactions & flushes 2023-02-07 19:03:15,491 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:15,491 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:15,491 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. after waiting 0 ms 2023-02-07 19:03:15,491 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:15,491 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:15,491 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 844d12f763403a7a07be89b8253371cc: Waiting for close lock at 1675796595490Disabling compacts and flushes for region at 1675796595490Disabling writes for close at 1675796595491 (+1 ms)Writing region close event to WAL at 1675796595491Closed at 1675796595491 2023-02-07 19:03:15,494 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,495 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 17f7d5e2d7cc46d4844e56280af889ea from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,495 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49278a87ecd9408db9aa18fbf9c0cec8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,497 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7ace7bb01437444da6e0dd2324884364 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 19:03:15,497 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing bae1c0d970d6fa537deb42aa4ca65775, disabling compactions & flushes 2023-02-07 19:03:15,497 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:15,497 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:15,497 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. after waiting 0 ms 2023-02-07 19:03:15,497 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:15,497 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:15,497 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for bae1c0d970d6fa537deb42aa4ca65775: Waiting for close lock at 1675796595497Disabling compacts and flushes for region at 1675796595497Disabling writes for close at 1675796595497Writing region close event to WAL at 1675796595497Closed at 1675796595497 2023-02-07 19:03:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e097679fa367eb82dbd32a7d37f4e963, disabling compactions & flushes 2023-02-07 19:03:15,501 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. after waiting 0 ms 2023-02-07 19:03:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:15,501 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:15,501 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e097679fa367eb82dbd32a7d37f4e963: Waiting for close lock at 1675796595501Disabling compacts and flushes for region at 1675796595501Disabling writes for close at 1675796595501Writing region close event to WAL at 1675796595501Closed at 1675796595501 2023-02-07 19:03:15,501 INFO [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675796593300 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:15,501 DEBUG [Listener at localhost/41793] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,501 DEBUG [Listener at localhost/41793] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf 2023-02-07 19:03:15,502 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:15,502 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:15,503 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 19:03:15,503 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------1b48fe07f2712b47c4e01783fe6b02a3/ 2023-02-07 19:03:15,504 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,504 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,504 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=1b48fe07f2712b47c4e01783fe6b02a3-98c68ce6f8ad42989e4a7e867067c6ab 2023-02-07 19:03:15,505 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,505 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=1b48fe07f2712b47c4e01783fe6b02a3-2f196bf2fca04a018552f92310af1d52 2023-02-07 19:03:15,505 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------3171d9d95a634937d91b9dc1f3b8a8a5/ 2023-02-07 19:03:15,505 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,505 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,506 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=3171d9d95a634937d91b9dc1f3b8a8a5-0c82ae790cbb42ecb3a7609486c1dee1 2023-02-07 19:03:15,506 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,506 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=3171d9d95a634937d91b9dc1f3b8a8a5-6368a3ee56f041aa9179613dbc16402c 2023-02-07 19:03:15,506 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------32646fb15d4909afb5300285d9a88228/ 2023-02-07 19:03:15,507 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,507 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,507 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=32646fb15d4909afb5300285d9a88228-213ed8407bd642c3b23234340113507e 2023-02-07 19:03:15,507 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,508 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=32646fb15d4909afb5300285d9a88228-41a8b8deaeab48fb8abfec98bb00f511 2023-02-07 19:03:15,508 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------49c9390b12f04bdca9455e0385741c4c/ 2023-02-07 19:03:15,508 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,508 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,509 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=49c9390b12f04bdca9455e0385741c4c-8285a3bfb7094864a00defd19c5c8a2f 2023-02-07 19:03:15,509 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,509 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=49c9390b12f04bdca9455e0385741c4c-d38cb704709c459987e9a7c282fd5b54 2023-02-07 19:03:15,509 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------4b9640448e0ff51eef07fadfdafd31a5/ 2023-02-07 19:03:15,510 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,510 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------844d12f763403a7a07be89b8253371cc/ 2023-02-07 19:03:15,510 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,510 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,511 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=844d12f763403a7a07be89b8253371cc-c6c55b40f86f4f13b842e7f44a24b63f 2023-02-07 19:03:15,511 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,512 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=844d12f763403a7a07be89b8253371cc-917a2e5af4644d6f9d8206edc3d5d5e4 2023-02-07 19:03:15,512 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------a60692693abae60624586adf40a8dfce/ 2023-02-07 19:03:15,512 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,512 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,513 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=a60692693abae60624586adf40a8dfce-dfc8fc631c2e47b280cd58b2a922f23a 2023-02-07 19:03:15,513 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,513 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=a60692693abae60624586adf40a8dfce-f273bc33a81c46d18bbac258d731d2cf 2023-02-07 19:03:15,513 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------b60f373395365bab4d169e7de139a9fe/ 2023-02-07 19:03:15,514 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,514 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------bae1c0d970d6fa537deb42aa4ca65775/ 2023-02-07 19:03:15,514 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,514 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,515 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=bae1c0d970d6fa537deb42aa4ca65775-c84d45fcbc5d4085b9feead9706417d8 2023-02-07 19:03:15,515 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,515 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=bae1c0d970d6fa537deb42aa4ca65775-49278a87ecd9408db9aa18fbf9c0cec8 2023-02-07 19:03:15,515 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |----------e097679fa367eb82dbd32a7d37f4e963/ 2023-02-07 19:03:15,515 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:15,516 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:15,516 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=e097679fa367eb82dbd32a7d37f4e963-17f7d5e2d7cc46d4844e56280af889ea 2023-02-07 19:03:15,516 DEBUG [Listener at localhost/41793] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:15,516 DEBUG [Listener at localhost/41793] util.CommonFSUtils(702): |----------------testWithMapReduce=e097679fa367eb82dbd32a7d37f4e963-7ace7bb01437444da6e0dd2324884364 2023-02-07 19:03:15,517 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,517 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,518 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,518 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,518 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,518 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,519 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,589 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop-5224682313383719850.jar 2023-02-07 19:03:15,590 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,590 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,591 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,591 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,591 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,592 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,592 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 19:03:15,592 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 19:03:15,593 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 19:03:15,593 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 19:03:15,594 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 19:03:15,595 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 19:03:15,595 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 19:03:15,596 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 19:03:15,596 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 19:03:15,597 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 19:03:15,598 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:15,598 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:15,599 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:15,599 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:15,600 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 19:03:15,670 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop-3496798825734787309.jar 2023-02-07 19:03:15,670 DEBUG [Listener at localhost/41793] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 19:03:15,676 WARN [Listener at localhost/41793] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 19:03:15,710 INFO [Listener at localhost/41793] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 19:03:15,810 WARN [Listener at localhost/41793] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/mapreduce.cluster.local.dir/1675796595777/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 19:03:15,810 WARN [Listener at localhost/41793] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/mapreduce.cluster.local.dir/1675796595777/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 19:03:15,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,846 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:15,847 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:15,849 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:15,850 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1 2023-02-07 19:03:15,850 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b48fe07f2712b47c4e01783fe6b02a3 columnFamilyName f1 2023-02-07 19:03:15,856 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f1/testWithMapReduce=1b48fe07f2712b47c4e01783fe6b02a3-98c68ce6f8ad42989e4a7e867067c6ab 2023-02-07 19:03:15,856 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(310): Store=1b48fe07f2712b47c4e01783fe6b02a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:15,856 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1b48fe07f2712b47c4e01783fe6b02a3 2023-02-07 19:03:15,857 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2 2023-02-07 19:03:15,857 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b48fe07f2712b47c4e01783fe6b02a3 columnFamilyName f2 2023-02-07 19:03:15,862 DEBUG [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/1b48fe07f2712b47c4e01783fe6b02a3/f2/testWithMapReduce=1b48fe07f2712b47c4e01783fe6b02a3-2f196bf2fca04a018552f92310af1d52 2023-02-07 19:03:15,862 INFO [StoreOpener-1b48fe07f2712b47c4e01783fe6b02a3-1] regionserver.HStore(310): Store=1b48fe07f2712b47c4e01783fe6b02a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:15,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:15,862 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1b48fe07f2712b47c4e01783fe6b02a3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65116847, jitterRate=-0.029683366417884827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:15,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1b48fe07f2712b47c4e01783fe6b02a3: Writing region info on filesystem at 1675796595847Initializing all the Stores at 1675796595848 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796595848Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796595848Region opened successfully at 1675796595862 (+14 ms) 2023-02-07 19:03:15,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1b48fe07f2712b47c4e01783fe6b02a3, disabling compactions & flushes 2023-02-07 19:03:15,894 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. after waiting 0 ms 2023-02-07 19:03:15,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,895 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675796591005.1b48fe07f2712b47c4e01783fe6b02a3. 2023-02-07 19:03:15,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1b48fe07f2712b47c4e01783fe6b02a3: Waiting for close lock at 1675796595894Disabling compacts and flushes for region at 1675796595894Disabling writes for close at 1675796595895 (+1 ms)Writing region close event to WAL at 1675796595895Closed at 1675796595895 2023-02-07 19:03:15,898 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,899 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:15,905 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:15,906 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:15,907 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1 2023-02-07 19:03:15,908 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32646fb15d4909afb5300285d9a88228 columnFamilyName f1 2023-02-07 19:03:15,913 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f1/testWithMapReduce=32646fb15d4909afb5300285d9a88228-213ed8407bd642c3b23234340113507e 2023-02-07 19:03:15,914 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(310): Store=32646fb15d4909afb5300285d9a88228/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:15,914 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32646fb15d4909afb5300285d9a88228 2023-02-07 19:03:15,915 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2 2023-02-07 19:03:15,915 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32646fb15d4909afb5300285d9a88228 columnFamilyName f2 2023-02-07 19:03:15,922 DEBUG [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/32646fb15d4909afb5300285d9a88228/f2/testWithMapReduce=32646fb15d4909afb5300285d9a88228-41a8b8deaeab48fb8abfec98bb00f511 2023-02-07 19:03:15,922 INFO [StoreOpener-32646fb15d4909afb5300285d9a88228-1] regionserver.HStore(310): Store=32646fb15d4909afb5300285d9a88228/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:15,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:15,923 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 32646fb15d4909afb5300285d9a88228; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61801312, jitterRate=-0.07908868789672852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:15,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 32646fb15d4909afb5300285d9a88228: Writing region info on filesystem at 1675796595905Initializing all the Stores at 1675796595906 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796595906Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796595906Region opened successfully at 1675796595923 (+17 ms) 2023-02-07 19:03:15,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 32646fb15d4909afb5300285d9a88228, disabling compactions & flushes 2023-02-07 19:03:15,955 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. after waiting 0 ms 2023-02-07 19:03:15,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,956 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675796591005.32646fb15d4909afb5300285d9a88228. 2023-02-07 19:03:15,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 32646fb15d4909afb5300285d9a88228: Waiting for close lock at 1675796595955Disabling compacts and flushes for region at 1675796595955Disabling writes for close at 1675796595955Writing region close event to WAL at 1675796595956 (+1 ms)Closed at 1675796595956 2023-02-07 19:03:15,959 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:15,959 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:15,963 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:15,965 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:15,967 DEBUG [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/f1 2023-02-07 19:03:15,967 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b9640448e0ff51eef07fadfdafd31a5 columnFamilyName f1 2023-02-07 19:03:15,968 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(310): Store=4b9640448e0ff51eef07fadfdafd31a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:15,968 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4b9640448e0ff51eef07fadfdafd31a5 2023-02-07 19:03:15,969 DEBUG [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/4b9640448e0ff51eef07fadfdafd31a5/f2 2023-02-07 19:03:15,969 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b9640448e0ff51eef07fadfdafd31a5 columnFamilyName f2 2023-02-07 19:03:15,970 INFO [StoreOpener-4b9640448e0ff51eef07fadfdafd31a5-1] regionserver.HStore(310): Store=4b9640448e0ff51eef07fadfdafd31a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:15,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:15,970 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4b9640448e0ff51eef07fadfdafd31a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60741339, jitterRate=-0.0948835164308548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:15,970 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4b9640448e0ff51eef07fadfdafd31a5: Writing region info on filesystem at 1675796595963Initializing all the Stores at 1675796595964 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796595964Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796595964Region opened successfully at 1675796595970 (+6 ms) 2023-02-07 19:03:15,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4b9640448e0ff51eef07fadfdafd31a5, disabling compactions & flushes 2023-02-07 19:03:15,999 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. after waiting 0 ms 2023-02-07 19:03:15,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,999 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796591005.4b9640448e0ff51eef07fadfdafd31a5. 2023-02-07 19:03:15,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4b9640448e0ff51eef07fadfdafd31a5: Waiting for close lock at 1675796595998Disabling compacts and flushes for region at 1675796595998Disabling writes for close at 1675796595999 (+1 ms)Writing region close event to WAL at 1675796595999Closed at 1675796595999 2023-02-07 19:03:16,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,006 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,007 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,009 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:16,010 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1 2023-02-07 19:03:16,010 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 844d12f763403a7a07be89b8253371cc columnFamilyName f1 2023-02-07 19:03:16,018 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f1/testWithMapReduce=844d12f763403a7a07be89b8253371cc-c6c55b40f86f4f13b842e7f44a24b63f 2023-02-07 19:03:16,018 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(310): Store=844d12f763403a7a07be89b8253371cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,018 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 844d12f763403a7a07be89b8253371cc 2023-02-07 19:03:16,019 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2 2023-02-07 19:03:16,019 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 844d12f763403a7a07be89b8253371cc columnFamilyName f2 2023-02-07 19:03:16,024 DEBUG [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/844d12f763403a7a07be89b8253371cc/f2/testWithMapReduce=844d12f763403a7a07be89b8253371cc-917a2e5af4644d6f9d8206edc3d5d5e4 2023-02-07 19:03:16,024 INFO [StoreOpener-844d12f763403a7a07be89b8253371cc-1] regionserver.HStore(310): Store=844d12f763403a7a07be89b8253371cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,024 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 844d12f763403a7a07be89b8253371cc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74977260, jitterRate=0.11724823713302612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 844d12f763403a7a07be89b8253371cc: Writing region info on filesystem at 1675796596007Initializing all the Stores at 1675796596008 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596008Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596008Region opened successfully at 1675796596024 (+16 ms) 2023-02-07 19:03:16,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 844d12f763403a7a07be89b8253371cc, disabling compactions & flushes 2023-02-07 19:03:16,053 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:16,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:16,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. after waiting 0 ms 2023-02-07 19:03:16,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:16,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675796591005.844d12f763403a7a07be89b8253371cc. 2023-02-07 19:03:16,055 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 844d12f763403a7a07be89b8253371cc: Waiting for close lock at 1675796596052Disabling compacts and flushes for region at 1675796596052Disabling writes for close at 1675796596053 (+1 ms)Writing region close event to WAL at 1675796596054 (+1 ms)Closed at 1675796596054 2023-02-07 19:03:16,058 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,058 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,059 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,062 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:16,063 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1 2023-02-07 19:03:16,063 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49c9390b12f04bdca9455e0385741c4c columnFamilyName f1 2023-02-07 19:03:16,068 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f1/testWithMapReduce=49c9390b12f04bdca9455e0385741c4c-8285a3bfb7094864a00defd19c5c8a2f 2023-02-07 19:03:16,068 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(310): Store=49c9390b12f04bdca9455e0385741c4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,068 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 49c9390b12f04bdca9455e0385741c4c 2023-02-07 19:03:16,069 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2 2023-02-07 19:03:16,069 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49c9390b12f04bdca9455e0385741c4c columnFamilyName f2 2023-02-07 19:03:16,074 DEBUG [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/49c9390b12f04bdca9455e0385741c4c/f2/testWithMapReduce=49c9390b12f04bdca9455e0385741c4c-d38cb704709c459987e9a7c282fd5b54 2023-02-07 19:03:16,074 INFO [StoreOpener-49c9390b12f04bdca9455e0385741c4c-1] regionserver.HStore(310): Store=49c9390b12f04bdca9455e0385741c4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,074 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 49c9390b12f04bdca9455e0385741c4c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61009282, jitterRate=-0.09089085459709167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 49c9390b12f04bdca9455e0385741c4c: Writing region info on filesystem at 1675796596060Initializing all the Stores at 1675796596061 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596061Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596061Region opened successfully at 1675796596074 (+13 ms) 2023-02-07 19:03:16,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 49c9390b12f04bdca9455e0385741c4c, disabling compactions & flushes 2023-02-07 19:03:16,104 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:16,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:16,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. after waiting 0 ms 2023-02-07 19:03:16,104 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:16,105 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675796591005.49c9390b12f04bdca9455e0385741c4c. 2023-02-07 19:03:16,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 49c9390b12f04bdca9455e0385741c4c: Waiting for close lock at 1675796596104Disabling compacts and flushes for region at 1675796596104Disabling writes for close at 1675796596104Writing region close event to WAL at 1675796596105 (+1 ms)Closed at 1675796596105 2023-02-07 19:03:16,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,109 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,110 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,112 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:16,113 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1 2023-02-07 19:03:16,113 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3171d9d95a634937d91b9dc1f3b8a8a5 columnFamilyName f1 2023-02-07 19:03:16,118 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f1/testWithMapReduce=3171d9d95a634937d91b9dc1f3b8a8a5-0c82ae790cbb42ecb3a7609486c1dee1 2023-02-07 19:03:16,118 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(310): Store=3171d9d95a634937d91b9dc1f3b8a8a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,118 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3171d9d95a634937d91b9dc1f3b8a8a5 2023-02-07 19:03:16,119 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2 2023-02-07 19:03:16,120 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3171d9d95a634937d91b9dc1f3b8a8a5 columnFamilyName f2 2023-02-07 19:03:16,126 DEBUG [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/3171d9d95a634937d91b9dc1f3b8a8a5/f2/testWithMapReduce=3171d9d95a634937d91b9dc1f3b8a8a5-6368a3ee56f041aa9179613dbc16402c 2023-02-07 19:03:16,126 INFO [StoreOpener-3171d9d95a634937d91b9dc1f3b8a8a5-1] regionserver.HStore(310): Store=3171d9d95a634937d91b9dc1f3b8a8a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,127 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,127 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3171d9d95a634937d91b9dc1f3b8a8a5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63892245, jitterRate=-0.047931358218193054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,127 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3171d9d95a634937d91b9dc1f3b8a8a5: Writing region info on filesystem at 1675796596110Initializing all the Stores at 1675796596111 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596111Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596111Region opened successfully at 1675796596127 (+16 ms) 2023-02-07 19:03:16,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3171d9d95a634937d91b9dc1f3b8a8a5, disabling compactions & flushes 2023-02-07 19:03:16,162 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:16,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:16,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. after waiting 0 ms 2023-02-07 19:03:16,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:16,163 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675796591005.3171d9d95a634937d91b9dc1f3b8a8a5. 2023-02-07 19:03:16,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3171d9d95a634937d91b9dc1f3b8a8a5: Waiting for close lock at 1675796596161Disabling compacts and flushes for region at 1675796596161Disabling writes for close at 1675796596162 (+1 ms)Writing region close event to WAL at 1675796596163 (+1 ms)Closed at 1675796596163 2023-02-07 19:03:16,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,166 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,167 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,169 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a60692693abae60624586adf40a8dfce 2023-02-07 19:03:16,170 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1 2023-02-07 19:03:16,170 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60692693abae60624586adf40a8dfce columnFamilyName f1 2023-02-07 19:03:16,174 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f1/testWithMapReduce=a60692693abae60624586adf40a8dfce-dfc8fc631c2e47b280cd58b2a922f23a 2023-02-07 19:03:16,175 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(310): Store=a60692693abae60624586adf40a8dfce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,175 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a60692693abae60624586adf40a8dfce 2023-02-07 19:03:16,175 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2 2023-02-07 19:03:16,176 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60692693abae60624586adf40a8dfce columnFamilyName f2 2023-02-07 19:03:16,180 DEBUG [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/a60692693abae60624586adf40a8dfce/f2/testWithMapReduce=a60692693abae60624586adf40a8dfce-f273bc33a81c46d18bbac258d731d2cf 2023-02-07 19:03:16,180 INFO [StoreOpener-a60692693abae60624586adf40a8dfce-1] regionserver.HStore(310): Store=a60692693abae60624586adf40a8dfce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,180 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,181 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a60692693abae60624586adf40a8dfce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60282829, jitterRate=-0.10171584784984589}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a60692693abae60624586adf40a8dfce: Writing region info on filesystem at 1675796596167Initializing all the Stores at 1675796596168 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596168Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596168Region opened successfully at 1675796596181 (+13 ms) 2023-02-07 19:03:16,214 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a60692693abae60624586adf40a8dfce, disabling compactions & flushes 2023-02-07 19:03:16,215 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:16,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:16,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. after waiting 0 ms 2023-02-07 19:03:16,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:16,216 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675796591005.a60692693abae60624586adf40a8dfce. 2023-02-07 19:03:16,216 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a60692693abae60624586adf40a8dfce: Waiting for close lock at 1675796596214Disabling compacts and flushes for region at 1675796596214Disabling writes for close at 1675796596215 (+1 ms)Writing region close event to WAL at 1675796596216 (+1 ms)Closed at 1675796596216 2023-02-07 19:03:16,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,219 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,222 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,224 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:16,225 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1 2023-02-07 19:03:16,225 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bae1c0d970d6fa537deb42aa4ca65775 columnFamilyName f1 2023-02-07 19:03:16,230 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f1/testWithMapReduce=bae1c0d970d6fa537deb42aa4ca65775-c84d45fcbc5d4085b9feead9706417d8 2023-02-07 19:03:16,230 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(310): Store=bae1c0d970d6fa537deb42aa4ca65775/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,230 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bae1c0d970d6fa537deb42aa4ca65775 2023-02-07 19:03:16,231 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2 2023-02-07 19:03:16,231 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bae1c0d970d6fa537deb42aa4ca65775 columnFamilyName f2 2023-02-07 19:03:16,237 DEBUG [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/bae1c0d970d6fa537deb42aa4ca65775/f2/testWithMapReduce=bae1c0d970d6fa537deb42aa4ca65775-49278a87ecd9408db9aa18fbf9c0cec8 2023-02-07 19:03:16,237 INFO [StoreOpener-bae1c0d970d6fa537deb42aa4ca65775-1] regionserver.HStore(310): Store=bae1c0d970d6fa537deb42aa4ca65775/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,237 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,237 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bae1c0d970d6fa537deb42aa4ca65775; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68212917, jitterRate=0.016451671719551086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,237 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bae1c0d970d6fa537deb42aa4ca65775: Writing region info on filesystem at 1675796596222Initializing all the Stores at 1675796596223 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596223Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596223Region opened successfully at 1675796596237 (+14 ms) 2023-02-07 19:03:16,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bae1c0d970d6fa537deb42aa4ca65775, disabling compactions & flushes 2023-02-07 19:03:16,264 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:16,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:16,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. after waiting 0 ms 2023-02-07 19:03:16,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:16,265 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675796591005.bae1c0d970d6fa537deb42aa4ca65775. 2023-02-07 19:03:16,265 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bae1c0d970d6fa537deb42aa4ca65775: Waiting for close lock at 1675796596264Disabling compacts and flushes for region at 1675796596264Disabling writes for close at 1675796596264Writing region close event to WAL at 1675796596265 (+1 ms)Closed at 1675796596265 2023-02-07 19:03:16,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,268 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,269 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,271 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:16,272 DEBUG [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/f1 2023-02-07 19:03:16,272 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60f373395365bab4d169e7de139a9fe columnFamilyName f1 2023-02-07 19:03:16,273 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(310): Store=b60f373395365bab4d169e7de139a9fe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,273 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b60f373395365bab4d169e7de139a9fe 2023-02-07 19:03:16,274 DEBUG [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/b60f373395365bab4d169e7de139a9fe/f2 2023-02-07 19:03:16,274 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b60f373395365bab4d169e7de139a9fe columnFamilyName f2 2023-02-07 19:03:16,274 INFO [StoreOpener-b60f373395365bab4d169e7de139a9fe-1] regionserver.HStore(310): Store=b60f373395365bab4d169e7de139a9fe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,275 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b60f373395365bab4d169e7de139a9fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71615986, jitterRate=0.06716135144233704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b60f373395365bab4d169e7de139a9fe: Writing region info on filesystem at 1675796596269Initializing all the Stores at 1675796596270 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596270Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596270Region opened successfully at 1675796596275 (+5 ms) 2023-02-07 19:03:16,291 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b60f373395365bab4d169e7de139a9fe, disabling compactions & flushes 2023-02-07 19:03:16,292 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:16,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:16,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. after waiting 0 ms 2023-02-07 19:03:16,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:16,292 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675796591005.b60f373395365bab4d169e7de139a9fe. 2023-02-07 19:03:16,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b60f373395365bab4d169e7de139a9fe: Waiting for close lock at 1675796596291Disabling compacts and flushes for region at 1675796596291Disabling writes for close at 1675796596292 (+1 ms)Writing region close event to WAL at 1675796596292Closed at 1675796596292 2023-02-07 19:03:16,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:16,295 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:16,296 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:16,298 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:16,299 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1 2023-02-07 19:03:16,299 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e097679fa367eb82dbd32a7d37f4e963 columnFamilyName f1 2023-02-07 19:03:16,303 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f1/testWithMapReduce=e097679fa367eb82dbd32a7d37f4e963-17f7d5e2d7cc46d4844e56280af889ea 2023-02-07 19:03:16,304 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(310): Store=e097679fa367eb82dbd32a7d37f4e963/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,304 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e097679fa367eb82dbd32a7d37f4e963 2023-02-07 19:03:16,305 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2 2023-02-07 19:03:16,305 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e097679fa367eb82dbd32a7d37f4e963 columnFamilyName f2 2023-02-07 19:03:16,309 DEBUG [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(539): loaded hdfs://localhost:40767/user/jenkins/test-data/9db22143-5089-a28c-bbaf-b9b3bb2a3c15/testWithMapReduceAndOfflineHBaseMultiRegion/60075022-901d-4426-a459-5a34aa7242bf/data/default/testWithMapReduce/e097679fa367eb82dbd32a7d37f4e963/f2/testWithMapReduce=e097679fa367eb82dbd32a7d37f4e963-7ace7bb01437444da6e0dd2324884364 2023-02-07 19:03:16,309 INFO [StoreOpener-e097679fa367eb82dbd32a7d37f4e963-1] regionserver.HStore(310): Store=e097679fa367eb82dbd32a7d37f4e963/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:16,309 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:16,310 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e097679fa367eb82dbd32a7d37f4e963; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64779090, jitterRate=-0.03471633791923523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:16,310 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e097679fa367eb82dbd32a7d37f4e963: Writing region info on filesystem at 1675796596296Initializing all the Stores at 1675796596297 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596297Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796596297Region opened successfully at 1675796596310 (+13 ms) 2023-02-07 19:03:16,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e097679fa367eb82dbd32a7d37f4e963, disabling compactions & flushes 2023-02-07 19:03:16,339 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:16,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:16,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. after waiting 0 ms 2023-02-07 19:03:16,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:16,340 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675796591005.e097679fa367eb82dbd32a7d37f4e963. 2023-02-07 19:03:16,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e097679fa367eb82dbd32a7d37f4e963: Waiting for close lock at 1675796596339Disabling compacts and flushes for region at 1675796596339Disabling writes for close at 1675796596339Writing region close event to WAL at 1675796596340 (+1 ms)Closed at 1675796596340 2023-02-07 19:03:16,846 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:16,847 WARN [Listener at localhost/41793] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:16,852 INFO [Listener at localhost/41793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:16,955 WARN [BP-1135088360-172.31.2.20-1675796588580 heartbeating to localhost/127.0.0.1:40767] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:16,957 WARN [BP-1135088360-172.31.2.20-1675796588580 heartbeating to localhost/127.0.0.1:40767] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1135088360-172.31.2.20-1675796588580 (Datanode Uuid 2d4e3f54-ebfa-49bf-b6ea-b0947062206e) service to localhost/127.0.0.1:40767 2023-02-07 19:03:16,958 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/dfs/data/data3/current/BP-1135088360-172.31.2.20-1675796588580] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:16,958 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/dfs/data/data4/current/BP-1135088360-172.31.2.20-1675796588580] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:16,960 WARN [Listener at localhost/41793] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:16,962 INFO [Listener at localhost/41793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:17,064 WARN [BP-1135088360-172.31.2.20-1675796588580 heartbeating to localhost/127.0.0.1:40767] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:17,065 WARN [BP-1135088360-172.31.2.20-1675796588580 heartbeating to localhost/127.0.0.1:40767] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1135088360-172.31.2.20-1675796588580 (Datanode Uuid 4b2222ea-8f3b-4f48-af41-89c3fecd653d) service to localhost/127.0.0.1:40767 2023-02-07 19:03:17,066 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/dfs/data/data1/current/BP-1135088360-172.31.2.20-1675796588580] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:17,066 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/cluster_a2cca6a2-cda2-f61e-a283-8d7c8708f38e/dfs/data/data2/current/BP-1135088360-172.31.2.20-1675796588580] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:17,075 INFO [Listener at localhost/41793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:17,198 INFO [Listener at localhost/41793] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:17,242 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:17,256 INFO [Listener at localhost/41793] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=156 (was 104) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:40767 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41793 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,34499,1675796589249)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40767 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:40767 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:40767 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:40767 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:40767 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:40767 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=546 (was 548), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 372) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4878 (was 5014) 2023-02-07 19:03:17,267 INFO [Listener at localhost/41793] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=156, OpenFileDescriptor=546, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=169, AvailableMemoryMB=4877 2023-02-07 19:03:17,277 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop.log.dir so I do NOT create it in target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb 2023-02-07 19:03:17,277 WARN [Listener at localhost/41793] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 19:03:17,277 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop.tmp.dir so I do NOT create it in target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb 2023-02-07 19:03:17,277 WARN [Listener at localhost/41793] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27923d5e-ac70-0172-46ed-193754cb2f7c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 19:03:17,277 DEBUG [Listener at localhost/41793] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586, deleteOnExit=true 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/test.cache.data in system properties and HBase conf 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:03:17,278 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:03:17,278 DEBUG [Listener at localhost/41793] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:03:17,279 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:03:17,280 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:03:17,280 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:17,280 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:03:17,280 INFO [Listener at localhost/41793] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:03:17,284 WARN [Listener at localhost/41793] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:17,284 WARN [Listener at localhost/41793] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:17,319 WARN [Listener at localhost/41793] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 19:03:17,404 WARN [Listener at localhost/41793] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:17,406 INFO [Listener at localhost/41793] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:17,411 INFO [Listener at localhost/41793] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/java.io.tmpdir/Jetty_localhost_37171_hdfs____.i0crqn/webapp 2023-02-07 19:03:17,502 INFO [Listener at localhost/41793] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37171 2023-02-07 19:03:17,506 WARN [Listener at localhost/41793] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:17,506 WARN [Listener at localhost/41793] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:17,549 WARN [Listener at localhost/44043] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:17,561 WARN [Listener at localhost/44043] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:17,564 WARN [Listener at localhost/44043] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:17,565 INFO [Listener at localhost/44043] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:17,572 INFO [Listener at localhost/44043] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/java.io.tmpdir/Jetty_localhost_44403_datanode____.6hquaq/webapp 2023-02-07 19:03:17,667 INFO [Listener at localhost/44043] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44403 2023-02-07 19:03:17,678 WARN [Listener at localhost/40423] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:17,692 WARN [Listener at localhost/40423] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:17,695 WARN [Listener at localhost/40423] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:17,696 INFO [Listener at localhost/40423] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:17,698 INFO [Listener at localhost/40423] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/java.io.tmpdir/Jetty_localhost_43225_datanode____.3b5fyb/webapp 2023-02-07 19:03:17,761 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x581422e70ff4e0b7: Processing first storage report for DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401 from datanode 8afb1692-074c-4570-93b8-2cc5492c92fb 2023-02-07 19:03:17,761 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x581422e70ff4e0b7: from storage DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401 node DatanodeRegistration(127.0.0.1:46681, datanodeUuid=8afb1692-074c-4570-93b8-2cc5492c92fb, infoPort=33535, infoSecurePort=0, ipcPort=40423, storageInfo=lv=-57;cid=testClusterID;nsid=1654635632;c=1675796597286), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 19:03:17,761 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x581422e70ff4e0b7: Processing first storage report for DS-e12d5e37-7829-4f88-8072-5d4d79303d18 from datanode 8afb1692-074c-4570-93b8-2cc5492c92fb 2023-02-07 19:03:17,761 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x581422e70ff4e0b7: from storage DS-e12d5e37-7829-4f88-8072-5d4d79303d18 node DatanodeRegistration(127.0.0.1:46681, datanodeUuid=8afb1692-074c-4570-93b8-2cc5492c92fb, infoPort=33535, infoSecurePort=0, ipcPort=40423, storageInfo=lv=-57;cid=testClusterID;nsid=1654635632;c=1675796597286), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:17,798 INFO [Listener at localhost/40423] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43225 2023-02-07 19:03:17,807 WARN [Listener at localhost/39319] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:17,971 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa59d1cc025a6a21f: Processing first storage report for DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d from datanode 36ff3284-7a8f-4fa7-b0ed-3c70fcfaeaf2 2023-02-07 19:03:17,971 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa59d1cc025a6a21f: from storage DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d node DatanodeRegistration(127.0.0.1:32937, datanodeUuid=36ff3284-7a8f-4fa7-b0ed-3c70fcfaeaf2, infoPort=42817, infoSecurePort=0, ipcPort=39319, storageInfo=lv=-57;cid=testClusterID;nsid=1654635632;c=1675796597286), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:17,971 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa59d1cc025a6a21f: Processing first storage report for DS-87c40ba4-afe7-49c0-a73f-38fefc5fe600 from datanode 36ff3284-7a8f-4fa7-b0ed-3c70fcfaeaf2 2023-02-07 19:03:17,971 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa59d1cc025a6a21f: from storage DS-87c40ba4-afe7-49c0-a73f-38fefc5fe600 node DatanodeRegistration(127.0.0.1:32937, datanodeUuid=36ff3284-7a8f-4fa7-b0ed-3c70fcfaeaf2, infoPort=42817, infoSecurePort=0, ipcPort=39319, storageInfo=lv=-57;cid=testClusterID;nsid=1654635632;c=1675796597286), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:18,019 DEBUG [Listener at localhost/39319] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb 2023-02-07 19:03:18,021 INFO [Listener at localhost/39319] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/zookeeper_0, clientPort=65187, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:03:18,022 INFO [Listener at localhost/39319] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=65187 2023-02-07 19:03:18,022 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,023 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,037 INFO [Listener at localhost/39319] util.FSUtils(479): Created version file at hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4 with version=8 2023-02-07 19:03:18,038 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,039 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,040 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44043/user/jenkins/test-data/1716deb1-43f0-04a3-b3cd-198667f3be90/hbase-staging 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:18,042 INFO [Listener at localhost/39319] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:18,043 INFO [Listener at localhost/39319] ipc.NettyRpcServer(120): Bind to /172.31.2.20:43131 2023-02-07 19:03:18,044 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,044 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,045 INFO [Listener at localhost/39319] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43131 connecting to ZooKeeper ensemble=127.0.0.1:65187 2023-02-07 19:03:18,052 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:431310x0, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:18,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43131-0x1013e9801490000 connected 2023-02-07 19:03:18,069 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:18,069 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:18,069 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:18,070 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43131 2023-02-07 19:03:18,070 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43131 2023-02-07 19:03:18,073 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43131 2023-02-07 19:03:18,074 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43131 2023-02-07 19:03:18,078 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43131 2023-02-07 19:03:18,078 INFO [Listener at localhost/39319] master.HMaster(439): hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4, hbase.cluster.distributed=false 2023-02-07 19:03:18,090 INFO [Listener at localhost/39319] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:18,091 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,091 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,091 INFO [Listener at localhost/39319] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:18,091 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,091 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:18,091 INFO [Listener at localhost/39319] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:18,093 INFO [Listener at localhost/39319] ipc.NettyRpcServer(120): Bind to /172.31.2.20:43045 2023-02-07 19:03:18,093 INFO [Listener at localhost/39319] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:18,094 DEBUG [Listener at localhost/39319] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:18,094 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,095 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,096 INFO [Listener at localhost/39319] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43045 connecting to ZooKeeper ensemble=127.0.0.1:65187 2023-02-07 19:03:18,099 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:430450x0, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:18,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43045-0x1013e9801490001 connected 2023-02-07 19:03:18,101 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:18,106 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:18,106 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:18,107 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43045 2023-02-07 19:03:18,110 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43045 2023-02-07 19:03:18,110 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43045 2023-02-07 19:03:18,114 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43045 2023-02-07 19:03:18,114 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43045 2023-02-07 19:03:18,125 INFO [Listener at localhost/39319] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:18,125 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,125 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,125 INFO [Listener at localhost/39319] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:18,125 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:18,125 INFO [Listener at localhost/39319] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:18,126 INFO [Listener at localhost/39319] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:18,127 INFO [Listener at localhost/39319] ipc.NettyRpcServer(120): Bind to /172.31.2.20:40381 2023-02-07 19:03:18,127 INFO [Listener at localhost/39319] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:18,128 DEBUG [Listener at localhost/39319] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:18,129 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,130 INFO [Listener at localhost/39319] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,131 INFO [Listener at localhost/39319] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40381 connecting to ZooKeeper ensemble=127.0.0.1:65187 2023-02-07 19:03:18,134 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:403810x0, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:18,138 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): regionserver:403810x0, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:18,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40381-0x1013e9801490002 connected 2023-02-07 19:03:18,138 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:18,139 DEBUG [Listener at localhost/39319] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:18,142 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40381 2023-02-07 19:03:18,142 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40381 2023-02-07 19:03:18,143 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40381 2023-02-07 19:03:18,146 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40381 2023-02-07 19:03:18,147 DEBUG [Listener at localhost/39319] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40381 2023-02-07 19:03:18,148 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,149 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:18,150 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,156 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:18,156 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:18,156 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:18,157 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,158 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:18,159 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,43131,1675796598041 from backup master directory 2023-02-07 19:03:18,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:18,160 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,160 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:18,160 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:18,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,176 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/hbase.id with ID: d3862bad-8229-4551-a442-f0936c4a4716 2023-02-07 19:03:18,187 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:18,189 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,197 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f8b20d4 to 127.0.0.1:65187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:18,202 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@540bd4fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:18,203 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:18,203 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:03:18,204 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:18,205 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store-tmp 2023-02-07 19:03:18,216 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:18,216 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:18,216 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:18,216 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:18,216 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:18,216 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:18,216 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:18,216 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796598216Disabling compacts and flushes for region at 1675796598216Disabling writes for close at 1675796598216Writing region close event to WAL at 1675796598216Closed at 1675796598216 2023-02-07 19:03:18,217 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/WALs/jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,219 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C43131%2C1675796598041, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/WALs/jenkins-hbase6.apache.org,43131,1675796598041, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/oldWALs, maxLogs=10 2023-02-07 19:03:18,237 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK] 2023-02-07 19:03:18,237 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK] 2023-02-07 19:03:18,239 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/WALs/jenkins-hbase6.apache.org,43131,1675796598041/jenkins-hbase6.apache.org%2C43131%2C1675796598041.1675796598220 2023-02-07 19:03:18,239 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK], DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK]] 2023-02-07 19:03:18,239 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:18,240 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:18,240 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:18,240 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:18,242 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:18,244 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:03:18,244 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:03:18,245 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,245 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:18,245 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:18,248 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:18,250 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:18,250 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68068802, jitterRate=0.014304190874099731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:18,250 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796598240Initializing all the Stores at 1675796598241 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796598241Cleaning up temporary data from old regions at 1675796598246 (+5 ms)Cleaning up detritus from prior splits at 1675796598246Region opened successfully at 1675796598250 (+4 ms) 2023-02-07 19:03:18,251 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:03:18,252 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:03:18,252 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:03:18,252 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:03:18,252 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 19:03:18,252 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 19:03:18,252 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:03:18,254 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:03:18,255 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:03:18,265 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:03:18,265 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:03:18,265 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:03:18,265 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:03:18,266 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:03:18,269 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,269 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:03:18,269 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:03:18,270 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:03:18,271 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:18,272 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:18,271 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:18,272 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,272 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,43131,1675796598041, sessionid=0x1013e9801490000, setting cluster-up flag (Was=false) 2023-02-07 19:03:18,276 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,282 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:03:18,283 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,286 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,290 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:03:18,291 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:18,291 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.hbase-snapshot/.tmp 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:18,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796628298 2023-02-07 19:03:18,298 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:03:18,298 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:03:18,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,299 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:18,301 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:03:18,302 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:03:18,302 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:03:18,302 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:03:18,302 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:03:18,302 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796598302,5,FailOnTimeoutGroup] 2023-02-07 19:03:18,303 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796598302,5,FailOnTimeoutGroup] 2023-02-07 19:03:18,303 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,303 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:03:18,303 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,303 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,309 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:18,309 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:18,310 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4 2023-02-07 19:03:18,319 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:18,320 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:18,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/info 2023-02-07 19:03:18,322 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:18,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:18,323 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:18,323 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:18,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:18,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/table 2023-02-07 19:03:18,325 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:18,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,326 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740 2023-02-07 19:03:18,326 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740 2023-02-07 19:03:18,328 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:18,329 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:18,330 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:18,331 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67790944, jitterRate=0.01016378402709961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:18,331 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796598320Initializing all the Stores at 1675796598320Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796598320Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796598320Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796598320Cleaning up temporary data from old regions at 1675796598327 (+7 ms)Cleaning up detritus from prior splits at 1675796598327Region opened successfully at 1675796598331 (+4 ms) 2023-02-07 19:03:18,331 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:18,331 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:18,331 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:18,331 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:18,331 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:18,331 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:18,331 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796598331Disabling compacts and flushes for region at 1675796598331Disabling writes for close at 1675796598331Writing region close event to WAL at 1675796598331Closed at 1675796598331 2023-02-07 19:03:18,332 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:18,332 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:03:18,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:03:18,333 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:03:18,335 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:03:18,348 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(952): ClusterId : d3862bad-8229-4551-a442-f0936c4a4716 2023-02-07 19:03:18,348 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(952): ClusterId : d3862bad-8229-4551-a442-f0936c4a4716 2023-02-07 19:03:18,348 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:18,349 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:18,352 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:18,352 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:18,352 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:18,352 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:18,355 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:18,356 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:18,356 DEBUG [RS:1;jenkins-hbase6:40381] zookeeper.ReadOnlyZKClient(139): Connect 0x1cf323a6 to 127.0.0.1:65187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:18,357 DEBUG [RS:0;jenkins-hbase6:43045] zookeeper.ReadOnlyZKClient(139): Connect 0x5de746ce to 127.0.0.1:65187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:18,363 DEBUG [RS:1;jenkins-hbase6:40381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1234ce48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:18,363 DEBUG [RS:1;jenkins-hbase6:40381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@160b48d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:18,363 DEBUG [RS:0;jenkins-hbase6:43045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5320b302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:18,364 DEBUG [RS:0;jenkins-hbase6:43045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@571f2dbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:18,372 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:40381 2023-02-07 19:03:18,372 INFO [RS:1;jenkins-hbase6:40381] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:18,372 INFO [RS:1;jenkins-hbase6:40381] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:18,372 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:18,372 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:43045 2023-02-07 19:03:18,372 INFO [RS:0;jenkins-hbase6:43045] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:18,372 INFO [RS:0;jenkins-hbase6:43045] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:18,372 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:18,372 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,43131,1675796598041 with isa=jenkins-hbase6.apache.org/172.31.2.20:40381, startcode=1675796598125 2023-02-07 19:03:18,373 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,43131,1675796598041 with isa=jenkins-hbase6.apache.org/172.31.2.20:43045, startcode=1675796598090 2023-02-07 19:03:18,373 DEBUG [RS:1;jenkins-hbase6:40381] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:18,373 DEBUG [RS:0;jenkins-hbase6:43045] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:18,375 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43501, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:18,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,377 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44115, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:18,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,377 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4 2023-02-07 19:03:18,377 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44043 2023-02-07 19:03:18,377 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:18,377 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4 2023-02-07 19:03:18,377 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44043 2023-02-07 19:03:18,377 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:18,379 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:18,387 DEBUG [RS:0;jenkins-hbase6:43045] zookeeper.ZKUtil(162): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,387 WARN [RS:0;jenkins-hbase6:43045] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:18,387 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,43045,1675796598090] 2023-02-07 19:03:18,387 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,40381,1675796598125] 2023-02-07 19:03:18,387 DEBUG [RS:1;jenkins-hbase6:40381] zookeeper.ZKUtil(162): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,387 INFO [RS:0;jenkins-hbase6:43045] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:18,387 WARN [RS:1;jenkins-hbase6:40381] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:18,387 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,387 INFO [RS:1;jenkins-hbase6:40381] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:18,388 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,392 DEBUG [RS:0;jenkins-hbase6:43045] zookeeper.ZKUtil(162): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,392 DEBUG [RS:1;jenkins-hbase6:40381] zookeeper.ZKUtil(162): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,392 DEBUG [RS:0;jenkins-hbase6:43045] zookeeper.ZKUtil(162): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,392 DEBUG [RS:1;jenkins-hbase6:40381] zookeeper.ZKUtil(162): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,393 DEBUG [RS:1;jenkins-hbase6:40381] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:18,393 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:18,393 INFO [RS:1;jenkins-hbase6:40381] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:18,393 INFO [RS:0;jenkins-hbase6:43045] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:18,394 INFO [RS:1;jenkins-hbase6:40381] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:18,394 INFO [RS:1;jenkins-hbase6:40381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:18,395 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,395 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:18,396 INFO [RS:0;jenkins-hbase6:43045] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:18,396 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,396 INFO [RS:0;jenkins-hbase6:43045] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:18,396 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,396 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,396 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,396 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:18,396 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,397 DEBUG [RS:1;jenkins-hbase6:40381] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,398 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,398 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,398 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,398 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,398 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,399 DEBUG [RS:0;jenkins-hbase6:43045] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:18,403 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,403 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,403 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,413 INFO [RS:1;jenkins-hbase6:40381] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:18,413 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40381,1675796598125-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,418 INFO [RS:0;jenkins-hbase6:43045] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:18,418 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43045,1675796598090-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,428 INFO [RS:1;jenkins-hbase6:40381] regionserver.Replication(203): jenkins-hbase6.apache.org,40381,1675796598125 started 2023-02-07 19:03:18,428 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,40381,1675796598125, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:40381, sessionid=0x1013e9801490002 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,40381,1675796598125' 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:18,428 DEBUG [RS:1;jenkins-hbase6:40381] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:18,429 DEBUG [RS:1;jenkins-hbase6:40381] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,40381,1675796598125' 2023-02-07 19:03:18,429 DEBUG [RS:1;jenkins-hbase6:40381] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:18,429 DEBUG [RS:1;jenkins-hbase6:40381] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:18,429 DEBUG [RS:1;jenkins-hbase6:40381] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:18,429 INFO [RS:1;jenkins-hbase6:40381] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:18,429 INFO [RS:1;jenkins-hbase6:40381] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:18,434 INFO [RS:0;jenkins-hbase6:43045] regionserver.Replication(203): jenkins-hbase6.apache.org,43045,1675796598090 started 2023-02-07 19:03:18,434 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,43045,1675796598090, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:43045, sessionid=0x1013e9801490001 2023-02-07 19:03:18,434 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:18,434 DEBUG [RS:0;jenkins-hbase6:43045] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,434 DEBUG [RS:0;jenkins-hbase6:43045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,43045,1675796598090' 2023-02-07 19:03:18,434 DEBUG [RS:0;jenkins-hbase6:43045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,43045,1675796598090' 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:18,435 DEBUG [RS:0;jenkins-hbase6:43045] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:18,435 INFO [RS:0;jenkins-hbase6:43045] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:18,435 INFO [RS:0;jenkins-hbase6:43045] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:18,485 DEBUG [jenkins-hbase6:43131] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:03:18,486 DEBUG [jenkins-hbase6:43131] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:18,487 DEBUG [jenkins-hbase6:43131] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:18,487 DEBUG [jenkins-hbase6:43131] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:18,487 DEBUG [jenkins-hbase6:43131] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:18,488 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,43045,1675796598090, state=OPENING 2023-02-07 19:03:18,490 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:03:18,491 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:18,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,43045,1675796598090}] 2023-02-07 19:03:18,492 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:18,646 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,647 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:18,648 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:18,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:03:18,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:18,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C43045%2C1675796598090.meta, suffix=.meta, logDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,43045,1675796598090, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/oldWALs, maxLogs=32 2023-02-07 19:03:18,670 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK] 2023-02-07 19:03:18,670 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK] 2023-02-07 19:03:18,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,43045,1675796598090/jenkins-hbase6.apache.org%2C43045%2C1675796598090.meta.1675796598656.meta 2023-02-07 19:03:18,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK], DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK]] 2023-02-07 19:03:18,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:18,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:03:18,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:03:18,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:03:18,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:03:18,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:18,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:03:18,673 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:03:18,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:18,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/info 2023-02-07 19:03:18,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/info 2023-02-07 19:03:18,676 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:18,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:18,677 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:18,677 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:18,677 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:18,678 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,678 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:18,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/table 2023-02-07 19:03:18,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/table 2023-02-07 19:03:18,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:18,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:18,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740 2023-02-07 19:03:18,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740 2023-02-07 19:03:18,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:18,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:18,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59490546, jitterRate=-0.11352178454399109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:18,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796598673Writing region info on filesystem at 1675796598673Initializing all the Stores at 1675796598674 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796598674Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796598674Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796598674Cleaning up temporary data from old regions at 1675796598682 (+8 ms)Cleaning up detritus from prior splits at 1675796598682Running coprocessor post-open hooks at 1675796598685 (+3 ms)Region opened successfully at 1675796598685 2023-02-07 19:03:18,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796598646 2023-02-07 19:03:18,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:03:18,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:03:18,689 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,43045,1675796598090, state=OPEN 2023-02-07 19:03:18,692 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:03:18,692 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:18,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:03:18,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,43045,1675796598090 in 200 msec 2023-02-07 19:03:18,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:03:18,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-07 19:03:18,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-07 19:03:18,696 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796598150, completionTime=-1 2023-02-07 19:03:18,696 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:03:18,696 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:03:18,699 DEBUG [hconnection-0x5843858c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:18,701 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:18,702 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:03:18,702 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796658702 2023-02-07 19:03:18,702 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796718702 2023-02-07 19:03:18,702 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-07 19:03:18,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43131,1675796598041-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43131,1675796598041-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43131,1675796598041-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:43131, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:18,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:03:18,711 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:18,711 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:03:18,712 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:03:18,713 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:18,713 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:18,715 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:18,715 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154 empty. 2023-02-07 19:03:18,716 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:18,716 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:03:18,725 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:18,726 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9a778719f4b1a35a821bad1d5cffb154, NAME => 'hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp 2023-02-07 19:03:18,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:18,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 9a778719f4b1a35a821bad1d5cffb154, disabling compactions & flushes 2023-02-07 19:03:18,732 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:18,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:18,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. after waiting 0 ms 2023-02-07 19:03:18,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:18,732 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:18,732 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 9a778719f4b1a35a821bad1d5cffb154: Waiting for close lock at 1675796598732Disabling compacts and flushes for region at 1675796598732Disabling writes for close at 1675796598732Writing region close event to WAL at 1675796598732Closed at 1675796598732 2023-02-07 19:03:18,734 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:18,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796598735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796598735"}]},"ts":"1675796598735"} 2023-02-07 19:03:18,736 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:18,737 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:18,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796598737"}]},"ts":"1675796598737"} 2023-02-07 19:03:18,738 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:03:18,742 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:18,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:18,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:18,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:18,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9a778719f4b1a35a821bad1d5cffb154, ASSIGN}] 2023-02-07 19:03:18,745 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9a778719f4b1a35a821bad1d5cffb154, ASSIGN 2023-02-07 19:03:18,746 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9a778719f4b1a35a821bad1d5cffb154, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,43045,1675796598090; forceNewPlan=false, retain=false 2023-02-07 19:03:18,896 INFO [jenkins-hbase6:43131] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:18,897 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9a778719f4b1a35a821bad1d5cffb154, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:18,897 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796598897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796598897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796598897"}]},"ts":"1675796598897"} 2023-02-07 19:03:18,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9a778719f4b1a35a821bad1d5cffb154, server=jenkins-hbase6.apache.org,43045,1675796598090}] 2023-02-07 19:03:19,054 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:19,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C43045%2C1675796598090, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,43045,1675796598090, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/oldWALs, maxLogs=32 2023-02-07 19:03:19,075 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK] 2023-02-07 19:03:19,076 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK] 2023-02-07 19:03:19,078 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,43045,1675796598090/jenkins-hbase6.apache.org%2C43045%2C1675796598090.1675796599056 2023-02-07 19:03:19,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK], DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK]] 2023-02-07 19:03:19,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9a778719f4b1a35a821bad1d5cffb154, NAME => 'hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:19,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:19,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,081 INFO [StoreOpener-9a778719f4b1a35a821bad1d5cffb154-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,082 DEBUG [StoreOpener-9a778719f4b1a35a821bad1d5cffb154-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/info 2023-02-07 19:03:19,082 DEBUG [StoreOpener-9a778719f4b1a35a821bad1d5cffb154-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/info 2023-02-07 19:03:19,082 INFO [StoreOpener-9a778719f4b1a35a821bad1d5cffb154-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a778719f4b1a35a821bad1d5cffb154 columnFamilyName info 2023-02-07 19:03:19,083 INFO [StoreOpener-9a778719f4b1a35a821bad1d5cffb154-1] regionserver.HStore(310): Store=9a778719f4b1a35a821bad1d5cffb154/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:19,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:19,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:19,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 9a778719f4b1a35a821bad1d5cffb154; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60982484, jitterRate=-0.0912901759147644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:19,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 9a778719f4b1a35a821bad1d5cffb154: Running coprocessor pre-open hook at 1675796599079Writing region info on filesystem at 1675796599079Initializing all the Stores at 1675796599080 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796599080Cleaning up temporary data from old regions at 1675796599084 (+4 ms)Cleaning up detritus from prior splits at 1675796599084Running coprocessor post-open hooks at 1675796599088 (+4 ms)Region opened successfully at 1675796599088 2023-02-07 19:03:19,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154., pid=6, masterSystemTime=1675796599051 2023-02-07 19:03:19,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:19,091 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:19,091 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9a778719f4b1a35a821bad1d5cffb154, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:19,091 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796599091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796599091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796599091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796599091"}]},"ts":"1675796599091"} 2023-02-07 19:03:19,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:03:19,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9a778719f4b1a35a821bad1d5cffb154, server=jenkins-hbase6.apache.org,43045,1675796598090 in 194 msec 2023-02-07 19:03:19,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:03:19,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9a778719f4b1a35a821bad1d5cffb154, ASSIGN in 351 msec 2023-02-07 19:03:19,096 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:19,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796599096"}]},"ts":"1675796599096"} 2023-02-07 19:03:19,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:03:19,100 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:19,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 389 msec 2023-02-07 19:03:19,112 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:03:19,114 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:19,114 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:19,117 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:03:19,126 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:19,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-07 19:03:19,139 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:03:19,145 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:19,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 19:03:19,157 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:03:19,159 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:03:19,159 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.999sec 2023-02-07 19:03:19,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:03:19,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:03:19,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:03:19,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43131,1675796598041-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:03:19,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,43131,1675796598041-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:03:19,163 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:03:19,249 DEBUG [Listener at localhost/39319] zookeeper.ReadOnlyZKClient(139): Connect 0x38b30264 to 127.0.0.1:65187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:19,254 DEBUG [Listener at localhost/39319] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4983e50d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:19,256 DEBUG [hconnection-0x7a457d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:19,257 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:19,259 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:19,259 DEBUG [Listener at localhost/39319] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:03:19,259 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,259 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,261 DEBUG [Listener at localhost/39319] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:03:19,262 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:40660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:03:19,263 INFO [Listener at localhost/39319] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:19,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:19,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:03:19,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.2.20:40660 deadline: 1675796659263, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:19,264 INFO [Listener at localhost/39319] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-07 19:03:19,264 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,264 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:19,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:19,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:19,268 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:19,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-07 19:03:19,269 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,269 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:19,269 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:19,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:19,271 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,271 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a empty. 2023-02-07 19:03:19,272 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,272 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-07 19:03:19,281 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:19,282 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => e7064675a6b50e5e7556d3e6e4a5fc8a, NAME => 'testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp 2023-02-07 19:03:19,288 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:19,288 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing e7064675a6b50e5e7556d3e6e4a5fc8a, disabling compactions & flushes 2023-02-07 19:03:19,288 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,289 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,289 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. after waiting 0 ms 2023-02-07 19:03:19,289 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,289 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,289 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for e7064675a6b50e5e7556d3e6e4a5fc8a: Waiting for close lock at 1675796599288Disabling compacts and flushes for region at 1675796599288Disabling writes for close at 1675796599289 (+1 ms)Writing region close event to WAL at 1675796599289Closed at 1675796599289 2023-02-07 19:03:19,290 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:19,291 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675796599291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796599291"}]},"ts":"1675796599291"} 2023-02-07 19:03:19,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:19,294 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:19,294 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796599294"}]},"ts":"1675796599294"} 2023-02-07 19:03:19,295 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-07 19:03:19,298 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:19,299 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:19,299 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:19,299 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:19,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, ASSIGN}] 2023-02-07 19:03:19,301 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, ASSIGN 2023-02-07 19:03:19,302 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,40381,1675796598125; forceNewPlan=false, retain=false 2023-02-07 19:03:19,370 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,371 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:19,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:19,431 INFO [RS:1;jenkins-hbase6:40381] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C40381%2C1675796598125, suffix=, logDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,40381,1675796598125, archiveDir=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/oldWALs, maxLogs=32 2023-02-07 19:03:19,446 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK] 2023-02-07 19:03:19,446 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK] 2023-02-07 19:03:19,448 INFO [RS:1;jenkins-hbase6:40381] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/WALs/jenkins-hbase6.apache.org,40381,1675796598125/jenkins-hbase6.apache.org%2C40381%2C1675796598125.1675796599431 2023-02-07 19:03:19,448 DEBUG [RS:1;jenkins-hbase6:40381] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46681,DS-3c5706f3-00e4-4ba1-9df9-edae16f5a401,DISK], DatanodeInfoWithStorage[127.0.0.1:32937,DS-67e8b16f-f88e-4da5-85ba-5189bf2c295d,DISK]] 2023-02-07 19:03:19,452 INFO [jenkins-hbase6:43131] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:19,452 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e7064675a6b50e5e7556d3e6e4a5fc8a, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:19,453 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675796599452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796599452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796599452"}]},"ts":"1675796599452"} 2023-02-07 19:03:19,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e7064675a6b50e5e7556d3e6e4a5fc8a, server=jenkins-hbase6.apache.org,40381,1675796598125}] 2023-02-07 19:03:19,572 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,572 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:19,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:19,607 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:19,607 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:19,608 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:19,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e7064675a6b50e5e7556d3e6e4a5fc8a, NAME => 'testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:19,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:19,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,613 INFO [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,614 DEBUG [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1 2023-02-07 19:03:19,614 DEBUG [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1 2023-02-07 19:03:19,615 INFO [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7064675a6b50e5e7556d3e6e4a5fc8a columnFamilyName f1 2023-02-07 19:03:19,615 INFO [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] regionserver.HStore(310): Store=e7064675a6b50e5e7556d3e6e4a5fc8a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:19,615 INFO [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,617 DEBUG [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2 2023-02-07 19:03:19,617 DEBUG [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2 2023-02-07 19:03:19,617 INFO [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7064675a6b50e5e7556d3e6e4a5fc8a columnFamilyName f2 2023-02-07 19:03:19,617 INFO [StoreOpener-e7064675a6b50e5e7556d3e6e4a5fc8a-1] regionserver.HStore(310): Store=e7064675a6b50e5e7556d3e6e4a5fc8a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:19,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:19,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:19,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:19,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened e7064675a6b50e5e7556d3e6e4a5fc8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59593967, jitterRate=-0.11198069155216217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:19,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for e7064675a6b50e5e7556d3e6e4a5fc8a: Running coprocessor pre-open hook at 1675796599612Writing region info on filesystem at 1675796599612Initializing all the Stores at 1675796599613 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796599613Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796599613Cleaning up temporary data from old regions at 1675796599619 (+6 ms)Cleaning up detritus from prior splits at 1675796599619Running coprocessor post-open hooks at 1675796599624 (+5 ms)Region opened successfully at 1675796599624 2023-02-07 19:03:19,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a., pid=12, masterSystemTime=1675796599607 2023-02-07 19:03:19,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:19,629 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e7064675a6b50e5e7556d3e6e4a5fc8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:19,629 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675796599629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796599629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796599629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796599629"}]},"ts":"1675796599629"} 2023-02-07 19:03:19,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 19:03:19,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e7064675a6b50e5e7556d3e6e4a5fc8a, server=jenkins-hbase6.apache.org,40381,1675796598125 in 177 msec 2023-02-07 19:03:19,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 19:03:19,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, ASSIGN in 333 msec 2023-02-07 19:03:19,634 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:19,635 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796599634"}]},"ts":"1675796599634"} 2023-02-07 19:03:19,636 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-07 19:03:19,639 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:19,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 373 msec 2023-02-07 19:03:19,874 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:19,874 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:19,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:19,876 INFO [Listener at localhost/39319] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-07 19:03:19,876 DEBUG [Listener at localhost/39319] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-07 19:03:19,876 INFO [Listener at localhost/39319] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:19,878 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-07 19:03:19,878 INFO [Listener at localhost/39319] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:19,878 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-07 19:03:19,879 INFO [Listener at localhost/39319] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:03:19,899 DEBUG [hconnection-0x7a457d-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:19,912 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:19,925 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40381] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,035 INFO [Listener at localhost/39319] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:03:20,035 INFO [Listener at localhost/39319] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:03:20,035 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,035 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 19:03:20,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796600037 (current time:1675796600037). 2023-02-07 19:03:20,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:03:20,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] zookeeper.ReadOnlyZKClient(139): Connect 0x1463da84 to 127.0.0.1:65187 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40acf1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:20,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:20,047 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1463da84 to 127.0.0.1:65187 2023-02-07 19:03:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:03:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 19:03:20,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 19:03:20,051 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 19:03:20,052 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675797200052 2023-02-07 19:03:20,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 19:03:20,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,054 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:20,054 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:03:20,055 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 19:03:20,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 19:03:20,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-07 19:03:20,056 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 19:03:20,057 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675797200057 2023-02-07 19:03:20,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-07 19:03:20,066 INFO [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-07 19:03:20,066 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:20,067 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-07 19:03:20,067 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-07 19:03:20,067 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,068 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,069 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:20,069 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:20,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:20,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:20,069 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:20,070 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,070 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-07 19:03:20,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 19:03:20,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 19:03:20,072 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 19:03:20,072 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 19:03:20,072 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:20,072 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:20,073 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 19:03:20,073 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 19:03:20,074 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,40381,1675796598125' joining acquired barrier for procedure (foo) in zk 2023-02-07 19:03:20,074 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 19:03:20,074 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 19:03:20,074 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,43045,1675796598090' joining acquired barrier for procedure (foo) in zk 2023-02-07 19:03:20,076 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,076 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:20,077 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,077 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,077 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:20,077 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,077 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:20,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,40381,1675796598125' joining acquired barrier for procedure 'foo' on coordinator 2023-02-07 19:03:20,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5724c9f2[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:20,079 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-07 19:03:20,079 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 19:03:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,081 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,081 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:20,081 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 19:03:20,081 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:20,081 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 19:03:20,082 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,082 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 19:03:20,082 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,43045,1675796598090' in zk 2023-02-07 19:03:20,082 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. started... 2023-02-07 19:03:20,082 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e7064675a6b50e5e7556d3e6e4a5fc8a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 19:03:20,084 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 19:03:20,084 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:20,084 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 19:03:20,108 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f1/a9ec317f8eb343d38f4915275814779f 2023-02-07 19:03:20,156 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:20,156 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,156 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-07 19:03:20,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:20,159 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:03:20,203 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f2/3aa1d7b1f2a54c788d774edced261f56 2023-02-07 19:03:20,208 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f1/a9ec317f8eb343d38f4915275814779f as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/a9ec317f8eb343d38f4915275814779f 2023-02-07 19:03:20,212 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/a9ec317f8eb343d38f4915275814779f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:20,215 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f2/3aa1d7b1f2a54c788d774edced261f56 as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/3aa1d7b1f2a54c788d774edced261f56 2023-02-07 19:03:20,219 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/3aa1d7b1f2a54c788d774edced261f56, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:20,220 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e7064675a6b50e5e7556d3e6e4a5fc8a in 138ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:20,220 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-07 19:03:20,220 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e7064675a6b50e5e7556d3e6e4a5fc8a: 2023-02-07 19:03:20,221 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.' region-info for snapshot=foo 2023-02-07 19:03:20,221 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:20,221 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/a9ec317f8eb343d38f4915275814779f] hfiles 2023-02-07 19:03:20,221 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/a9ec317f8eb343d38f4915275814779f for snapshot=foo 2023-02-07 19:03:20,221 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/3aa1d7b1f2a54c788d774edced261f56] hfiles 2023-02-07 19:03:20,221 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/3aa1d7b1f2a54c788d774edced261f56 for snapshot=foo 2023-02-07 19:03:20,227 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. completed. 2023-02-07 19:03:20,227 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,227 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 19:03:20,227 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 19:03:20,227 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,227 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 19:03:20,227 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,40381,1675796598125' in zk 2023-02-07 19:03:20,230 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 19:03:20,230 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,230 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:20,230 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 19:03:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase6.apache.org,40381,1675796598125': 2023-02-07 19:03:20,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,40381,1675796598125' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-07 19:03:20,234 INFO [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-07 19:03:20,234 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:20,234 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:20,234 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-07 19:03:20,234 INFO [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:20,236 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:20,236 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:20,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:20,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:20,237 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:20,238 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,240 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:20,240 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,247 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,247 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:20,247 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:20,247 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:20,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:20,247 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:20,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:20,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:20,247 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:20,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:20,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:20,248 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:20,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:20,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:20,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.hbase-snapshot/.tmp/foo 2023-02-07 19:03:20,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.hbase-snapshot/.tmp/foo to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.hbase-snapshot/foo 2023-02-07 19:03:20,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-07 19:03:20,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.hbase-snapshot/.tmp/foo 2023-02-07 19:03:20,287 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.hbase-snapshot/.tmp/foo 2023-02-07 19:03:20,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675796600052Consolidate snapshot: foo at 1675796600248 (+196 ms)Loading Region manifests for foo at 1675796600248Writing data manifest for foo at 1675796600252 (+4 ms)Verifying snapshot: foo at 1675796600262 (+10 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675796600286 (+24 ms) 2023-02-07 19:03:20,289 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 19:03:20,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 236 msec 2023-02-07 19:03:20,360 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:20,360 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,360 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-07 19:03:20,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:20,361 INFO [Listener at localhost/39319] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:20,362 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,362 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,366 INFO [Listener at localhost/39319] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:20,371 INFO [Listener at localhost/39319] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:20,405 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40381] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,494 INFO [Listener at localhost/39319] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:20,498 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,498 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:20,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,503 INFO [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-07 19:03:20,503 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:20,504 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-07 19:03:20,504 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-07 19:03:20,504 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,504 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,506 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:20,506 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:20,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:20,506 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,507 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,507 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,509 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-07 19:03:20,509 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:20,509 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-07 19:03:20,509 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-07 19:03:20,509 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:20,509 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-07 19:03:20,510 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,43045,1675796598090' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-07 19:03:20,510 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-07 19:03:20,511 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 19:03:20,511 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:20,511 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,511 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. started... 2023-02-07 19:03:20,511 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e7064675a6b50e5e7556d3e6e4a5fc8a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 19:03:20,512 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,513 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,513 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:20,527 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f1/22e27f2561074aabaa7262e3e9ef5353 2023-02-07 19:03:20,545 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f2/91f30f2d890b4038bdd60630c05c7510 2023-02-07 19:03:20,549 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f1/22e27f2561074aabaa7262e3e9ef5353 as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/22e27f2561074aabaa7262e3e9ef5353 2023-02-07 19:03:20,553 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/22e27f2561074aabaa7262e3e9ef5353, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:20,554 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/.tmp/f2/91f30f2d890b4038bdd60630c05c7510 as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/91f30f2d890b4038bdd60630c05c7510 2023-02-07 19:03:20,558 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/91f30f2d890b4038bdd60630c05c7510, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:20,559 INFO [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e7064675a6b50e5e7556d3e6e4a5fc8a in 48ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:20,560 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e7064675a6b50e5e7556d3e6e4a5fc8a: 2023-02-07 19:03:20,560 DEBUG [rs(jenkins-hbase6.apache.org,40381,1675796598125)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,560 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 19:03:20,560 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 19:03:20,560 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,560 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-07 19:03:20,560 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,40381,1675796598125' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-07 19:03:20,562 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,562 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:20,562 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,562 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:20,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:20,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,40381,1675796598125' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-07 19:03:20,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@531b47ce[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:20,564 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-07 19:03:20,564 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,566 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-07 19:03:20,566 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-07 19:03:20,566 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-07 19:03:20,566 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-07 19:03:20,566 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase6.apache.org,40381,1675796598125' in zk 2023-02-07 19:03:20,566 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,566 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:20,566 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase6.apache.org,43045,1675796598090' in zk 2023-02-07 19:03:20,568 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,568 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-07 19:03:20,568 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:20,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:20,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:20,568 DEBUG [member: 'jenkins-hbase6.apache.org,40381,1675796598125' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-07 19:03:20,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:20,569 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-07 19:03:20,569 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:20,569 DEBUG [member: 'jenkins-hbase6.apache.org,43045,1675796598090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-07 19:03:20,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:20,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase6.apache.org,40381,1675796598125': 2023-02-07 19:03:20,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,40381,1675796598125' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-07 19:03:20,572 INFO [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-07 19:03:20,572 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:20,573 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:20,573 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,573 INFO [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:20,574 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,574 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,574 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:20,574 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,574 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:20,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,575 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:20,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:20,575 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,577 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,577 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:20,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,581 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:20,581 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:20,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:20,581 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:20,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:20,581 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:20,581 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-07 19:03:20,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:20,582 DEBUG [(jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:20,582 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,582 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:20,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:20,582 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,583 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,683 DEBUG [Listener at localhost/39319] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:20,683 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,683 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:20,689 INFO [Listener at localhost/39319] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675796600037 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:20,689 DEBUG [Listener at localhost/39319] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44043/user/jenkins/test-data/1716deb1-43f0-04a3-b3cd-198667f3be90/foo/61fa3ae0-16fc-4beb-b4cc-25206ac76beb/data/default/testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,690 INFO [Listener at localhost/39319] snapshot.RestoreSnapshotHelper(239): region to add: e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:20,690 INFO [Listener at localhost/39319] snapshot.RestoreSnapshotHelper(585): clone region=e7064675a6b50e5e7556d3e6e4a5fc8a as e7064675a6b50e5e7556d3e6e4a5fc8a in snapshot foo 2023-02-07 19:03:20,690 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e7064675a6b50e5e7556d3e6e4a5fc8a, NAME => 'testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44043/user/jenkins/test-data/1716deb1-43f0-04a3-b3cd-198667f3be90/foo/61fa3ae0-16fc-4beb-b4cc-25206ac76beb 2023-02-07 19:03:20,698 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:20,698 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9ec317f8eb343d38f4915275814779f from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,701 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3aa1d7b1f2a54c788d774edced261f56 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e7064675a6b50e5e7556d3e6e4a5fc8a, disabling compactions & flushes 2023-02-07 19:03:20,707 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. after waiting 0 ms 2023-02-07 19:03:20,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,707 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,707 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e7064675a6b50e5e7556d3e6e4a5fc8a: Waiting for close lock at 1675796600707Disabling compacts and flushes for region at 1675796600707Disabling writes for close at 1675796600707Writing region close event to WAL at 1675796600707Closed at 1675796600707 2023-02-07 19:03:20,707 INFO [Listener at localhost/39319] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675796600037 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:20,707 DEBUG [Listener at localhost/39319] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44043/user/jenkins/test-data/1716deb1-43f0-04a3-b3cd-198667f3be90/foo/61fa3ae0-16fc-4beb-b4cc-25206ac76beb 2023-02-07 19:03:20,707 DEBUG [Listener at localhost/39319] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44043/user/jenkins/test-data/1716deb1-43f0-04a3-b3cd-198667f3be90/foo/61fa3ae0-16fc-4beb-b4cc-25206ac76beb 2023-02-07 19:03:20,708 DEBUG [Listener at localhost/39319] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:20,708 DEBUG [Listener at localhost/39319] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:20,709 DEBUG [Listener at localhost/39319] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-07 19:03:20,709 DEBUG [Listener at localhost/39319] util.CommonFSUtils(699): |----------e7064675a6b50e5e7556d3e6e4a5fc8a/ 2023-02-07 19:03:20,710 DEBUG [Listener at localhost/39319] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:20,710 DEBUG [Listener at localhost/39319] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:20,710 DEBUG [Listener at localhost/39319] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=e7064675a6b50e5e7556d3e6e4a5fc8a-a9ec317f8eb343d38f4915275814779f 2023-02-07 19:03:20,711 DEBUG [Listener at localhost/39319] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:20,711 DEBUG [Listener at localhost/39319] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=e7064675a6b50e5e7556d3e6e4a5fc8a-3aa1d7b1f2a54c788d774edced261f56 2023-02-07 19:03:20,711 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,711 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "foo" 2023-02-07 19:03:20,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-07 19:03:20,716 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,716 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,716 INFO [Listener at localhost/39319] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:20,719 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,720 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,720 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796600720"}]},"ts":"1675796600720"} 2023-02-07 19:03:20,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:20,721 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-07 19:03:20,723 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-07 19:03:20,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, UNASSIGN}] 2023-02-07 19:03:20,725 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, UNASSIGN 2023-02-07 19:03:20,726 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e7064675a6b50e5e7556d3e6e4a5fc8a, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:20,726 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675796600726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796600726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796600726"}]},"ts":"1675796600726"} 2023-02-07 19:03:20,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e7064675a6b50e5e7556d3e6e4a5fc8a, server=jenkins-hbase6.apache.org,40381,1675796598125}] 2023-02-07 19:03:20,821 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:20,821 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:20,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:20,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:20,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing e7064675a6b50e5e7556d3e6e4a5fc8a, disabling compactions & flushes 2023-02-07 19:03:20,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. after waiting 0 ms 2023-02-07 19:03:20,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:20,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a. 2023-02-07 19:03:20,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for e7064675a6b50e5e7556d3e6e4a5fc8a: Waiting for close lock at 1675796600879Running coprocessor pre-close hooks at 1675796600879Disabling compacts and flushes for region at 1675796600879Disabling writes for close at 1675796600879Writing region close event to WAL at 1675796600880 (+1 ms)Running coprocessor post-close hooks at 1675796600883 (+3 ms)Closed at 1675796600883 2023-02-07 19:03:20,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:20,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e7064675a6b50e5e7556d3e6e4a5fc8a, regionState=CLOSED 2023-02-07 19:03:20,886 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675796600885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796600885"}]},"ts":"1675796600885"} 2023-02-07 19:03:20,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 19:03:20,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e7064675a6b50e5e7556d3e6e4a5fc8a, server=jenkins-hbase6.apache.org,40381,1675796598125 in 160 msec 2023-02-07 19:03:20,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 19:03:20,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=e7064675a6b50e5e7556d3e6e4a5fc8a, UNASSIGN in 164 msec 2023-02-07 19:03:20,890 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796600890"}]},"ts":"1675796600890"} 2023-02-07 19:03:20,891 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-07 19:03:20,893 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-07 19:03:20,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-07 19:03:21,023 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:21,023 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:21,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:21,024 INFO [Listener at localhost/39319] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-07 19:03:21,025 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:21,025 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:21,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,028 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:21,028 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:21,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:21,032 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:21,033 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2, FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/recovered.edits] 2023-02-07 19:03:21,037 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/22e27f2561074aabaa7262e3e9ef5353 to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/archive/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/22e27f2561074aabaa7262e3e9ef5353 2023-02-07 19:03:21,038 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/a9ec317f8eb343d38f4915275814779f to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/archive/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f1/a9ec317f8eb343d38f4915275814779f 2023-02-07 19:03:21,041 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/3aa1d7b1f2a54c788d774edced261f56 to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/archive/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/3aa1d7b1f2a54c788d774edced261f56 2023-02-07 19:03:21,042 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/91f30f2d890b4038bdd60630c05c7510 to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/archive/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/f2/91f30f2d890b4038bdd60630c05c7510 2023-02-07 19:03:21,044 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/recovered.edits/12.seqid to hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/archive/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a/recovered.edits/12.seqid 2023-02-07 19:03:21,044 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/e7064675a6b50e5e7556d3e6e4a5fc8a 2023-02-07 19:03:21,044 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-07 19:03:21,046 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,048 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-07 19:03:21,050 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-07 19:03:21,051 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,051 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-07 19:03:21,051 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796601051"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:21,052 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 19:03:21,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e7064675a6b50e5e7556d3e6e4a5fc8a, NAME => 'testInitTableSnapshotMapperJobConfig,,1675796599266.e7064675a6b50e5e7556d3e6e4a5fc8a.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 19:03:21,052 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-07 19:03:21,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675796601052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:21,056 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-07 19:03:21,057 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 19:03:21,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-07 19:03:21,129 INFO [Listener at localhost/39319] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:21,130 INFO [Listener at localhost/39319] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:21,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43131] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:21,131 INFO [Listener at localhost/39319] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-07 19:03:21,132 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:21,132 INFO [Listener at localhost/39319] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:21,132 DEBUG [Listener at localhost/39319] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38b30264 to 127.0.0.1:65187 2023-02-07 19:03:21,132 DEBUG [Listener at localhost/39319] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,132 DEBUG [Listener at localhost/39319] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:21,132 DEBUG [Listener at localhost/39319] util.JVMClusterUtil(257): Found active master hash=1698940797, stopped=false 2023-02-07 19:03:21,132 INFO [Listener at localhost/39319] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:21,136 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:21,136 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:21,136 INFO [Listener at localhost/39319] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:21,136 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:21,136 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:21,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:21,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:21,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:21,137 DEBUG [Listener at localhost/39319] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f8b20d4 to 127.0.0.1:65187 2023-02-07 19:03:21,138 DEBUG [Listener at localhost/39319] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,138 INFO [Listener at localhost/39319] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,43045,1675796598090' ***** 2023-02-07 19:03:21,138 INFO [Listener at localhost/39319] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:21,138 INFO [Listener at localhost/39319] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,40381,1675796598125' ***** 2023-02-07 19:03:21,138 INFO [Listener at localhost/39319] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:21,138 INFO [RS:1;jenkins-hbase6:40381] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:21,138 INFO [RS:0;jenkins-hbase6:43045] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:21,138 INFO [RS:0;jenkins-hbase6:43045] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:21,138 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:21,138 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:21,139 INFO [RS:1;jenkins-hbase6:40381] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:21,140 INFO [RS:0;jenkins-hbase6:43045] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:21,140 INFO [RS:1;jenkins-hbase6:40381] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:21,140 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(3304): Received CLOSE for 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:21,140 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:21,141 DEBUG [RS:1;jenkins-hbase6:40381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cf323a6 to 127.0.0.1:65187 2023-02-07 19:03:21,141 DEBUG [RS:1;jenkins-hbase6:40381] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,141 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,40381,1675796598125; all regions closed. 2023-02-07 19:03:21,141 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:21,141 DEBUG [RS:0;jenkins-hbase6:43045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5de746ce to 127.0.0.1:65187 2023-02-07 19:03:21,141 DEBUG [RS:0;jenkins-hbase6:43045] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,141 INFO [RS:0;jenkins-hbase6:43045] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:21,141 INFO [RS:0;jenkins-hbase6:43045] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:21,141 INFO [RS:0;jenkins-hbase6:43045] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:21,141 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:21,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 9a778719f4b1a35a821bad1d5cffb154, disabling compactions & flushes 2023-02-07 19:03:21,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:21,143 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-07 19:03:21,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:21,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:21,143 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1479): Online Regions={9a778719f4b1a35a821bad1d5cffb154=hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154., 1588230740=hbase:meta,,1.1588230740} 2023-02-07 19:03:21,144 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1505): Waiting on 1588230740, 9a778719f4b1a35a821bad1d5cffb154 2023-02-07 19:03:21,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:21,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. after waiting 0 ms 2023-02-07 19:03:21,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:21,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:21,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:21,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 9a778719f4b1a35a821bad1d5cffb154 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:21,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:21,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-07 19:03:21,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/.tmp/info/0d308a8d120e41028f35d5b9520a4c1b 2023-02-07 19:03:21,163 DEBUG [RS:1;jenkins-hbase6:40381] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/oldWALs 2023-02-07 19:03:21,164 INFO [RS:1;jenkins-hbase6:40381] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C40381%2C1675796598125:(num 1675796599431) 2023-02-07 19:03:21,164 DEBUG [RS:1;jenkins-hbase6:40381] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,164 INFO [RS:1;jenkins-hbase6:40381] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:21,164 INFO [RS:1;jenkins-hbase6:40381] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:21,164 INFO [RS:1;jenkins-hbase6:40381] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:21,164 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:21,164 INFO [RS:1;jenkins-hbase6:40381] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:21,164 INFO [RS:1;jenkins-hbase6:40381] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:21,165 INFO [RS:1;jenkins-hbase6:40381] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:40381 2023-02-07 19:03:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/.tmp/info/0d308a8d120e41028f35d5b9520a4c1b as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/info/0d308a8d120e41028f35d5b9520a4c1b 2023-02-07 19:03:21,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/info/0d308a8d120e41028f35d5b9520a4c1b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:21,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9a778719f4b1a35a821bad1d5cffb154 in 30ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:21,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/namespace/9a778719f4b1a35a821bad1d5cffb154/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:21,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 9a778719f4b1a35a821bad1d5cffb154: Waiting for close lock at 1675796601141Running coprocessor pre-close hooks at 1675796601141Disabling compacts and flushes for region at 1675796601141Disabling writes for close at 1675796601144 (+3 ms)Obtaining lock to block concurrent updates at 1675796601144Preparing flush snapshotting stores in 9a778719f4b1a35a821bad1d5cffb154 at 1675796601144Finished memstore snapshotting hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796601145 (+1 ms)Flushing stores of hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. at 1675796601145Flushing 9a778719f4b1a35a821bad1d5cffb154/info: creating writer at 1675796601145Flushing 9a778719f4b1a35a821bad1d5cffb154/info: appending metadata at 1675796601148 (+3 ms)Flushing 9a778719f4b1a35a821bad1d5cffb154/info: closing flushed file at 1675796601148Flushing 9a778719f4b1a35a821bad1d5cffb154/info: reopening flushed file at 1675796601170 (+22 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9a778719f4b1a35a821bad1d5cffb154 in 30ms, sequenceid=6, compaction requested=false at 1675796601174 (+4 ms)Writing region close event to WAL at 1675796601175 (+1 ms)Running coprocessor post-close hooks at 1675796601178 (+3 ms)Closed at 1675796601178 2023-02-07 19:03:21,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796598710.9a778719f4b1a35a821bad1d5cffb154. 2023-02-07 19:03:21,201 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:21,205 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:21,246 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:21,246 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:21,246 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,40381,1675796598125 2023-02-07 19:03:21,246 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@528c0b4a rejected from java.util.concurrent.ThreadPoolExecutor@56b395c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,246 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:21,246 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:21,246 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@100ccbd2 rejected from java.util.concurrent.ThreadPoolExecutor@56b395c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,247 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,40381,1675796598125] 2023-02-07 19:03:21,248 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,40381,1675796598125; numProcessing=1 2023-02-07 19:03:21,249 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,40381,1675796598125 already deleted, retry=false 2023-02-07 19:03:21,249 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,40381,1675796598125 expired; onlineServers=1 2023-02-07 19:03:21,344 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 19:03:21,403 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 19:03:21,403 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 19:03:21,536 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:21,536 INFO [RS:1;jenkins-hbase6:40381] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,40381,1675796598125; zookeeper connection closed. 2023-02-07 19:03:21,536 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@683fc0c1 rejected from java.util.concurrent.ThreadPoolExecutor@56b395c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,536 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:40381-0x1013e9801490002, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:21,536 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53af9c4 rejected from java.util.concurrent.ThreadPoolExecutor@56b395c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,536 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45b47775] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45b47775 2023-02-07 19:03:21,544 DEBUG [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 19:03:21,563 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/.tmp/info/098319f307704a9e814864abf3a5f1af 2023-02-07 19:03:21,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 098319f307704a9e814864abf3a5f1af 2023-02-07 19:03:21,580 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/.tmp/rep_barrier/fa459322d36b4e538573d13e20f5b9ba 2023-02-07 19:03:21,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa459322d36b4e538573d13e20f5b9ba 2023-02-07 19:03:21,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/.tmp/table/8c6edc727b8146cca2bc29bd259a8cbd 2023-02-07 19:03:21,594 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c6edc727b8146cca2bc29bd259a8cbd 2023-02-07 19:03:21,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/.tmp/info/098319f307704a9e814864abf3a5f1af as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/info/098319f307704a9e814864abf3a5f1af 2023-02-07 19:03:21,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 098319f307704a9e814864abf3a5f1af 2023-02-07 19:03:21,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/info/098319f307704a9e814864abf3a5f1af, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 19:03:21,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/.tmp/rep_barrier/fa459322d36b4e538573d13e20f5b9ba as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/rep_barrier/fa459322d36b4e538573d13e20f5b9ba 2023-02-07 19:03:21,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa459322d36b4e538573d13e20f5b9ba 2023-02-07 19:03:21,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/rep_barrier/fa459322d36b4e538573d13e20f5b9ba, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 19:03:21,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/.tmp/table/8c6edc727b8146cca2bc29bd259a8cbd as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/table/8c6edc727b8146cca2bc29bd259a8cbd 2023-02-07 19:03:21,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c6edc727b8146cca2bc29bd259a8cbd 2023-02-07 19:03:21,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/table/8c6edc727b8146cca2bc29bd259a8cbd, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 19:03:21,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 466ms, sequenceid=21, compaction requested=false 2023-02-07 19:03:21,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 19:03:21,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:21,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:21,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796601143Running coprocessor pre-close hooks at 1675796601143Disabling compacts and flushes for region at 1675796601143Disabling writes for close at 1675796601144 (+1 ms)Obtaining lock to block concurrent updates at 1675796601144Preparing flush snapshotting stores in 1588230740 at 1675796601144Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675796601145 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675796601146 (+1 ms)Flushing 1588230740/info: creating writer at 1675796601146Flushing 1588230740/info: appending metadata at 1675796601148 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675796601148Flushing 1588230740/rep_barrier: creating writer at 1675796601569 (+421 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675796601571 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675796601571Flushing 1588230740/table: creating writer at 1675796601583 (+12 ms)Flushing 1588230740/table: appending metadata at 1675796601585 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796601585Flushing 1588230740/info: reopening flushed file at 1675796601595 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675796601601 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675796601606 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 466ms, sequenceid=21, compaction requested=false at 1675796601610 (+4 ms)Writing region close event to WAL at 1675796601615 (+5 ms)Running coprocessor post-close hooks at 1675796601618 (+3 ms)Closed at 1675796601618 2023-02-07 19:03:21,618 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:21,744 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,43045,1675796598090; all regions closed. 2023-02-07 19:03:21,750 DEBUG [RS:0;jenkins-hbase6:43045] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/oldWALs 2023-02-07 19:03:21,750 INFO [RS:0;jenkins-hbase6:43045] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C43045%2C1675796598090.meta:.meta(num 1675796598656) 2023-02-07 19:03:21,754 DEBUG [RS:0;jenkins-hbase6:43045] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/oldWALs 2023-02-07 19:03:21,754 INFO [RS:0;jenkins-hbase6:43045] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C43045%2C1675796598090:(num 1675796599056) 2023-02-07 19:03:21,754 DEBUG [RS:0;jenkins-hbase6:43045] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,754 INFO [RS:0;jenkins-hbase6:43045] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:21,754 INFO [RS:0;jenkins-hbase6:43045] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:21,754 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:21,755 INFO [RS:0;jenkins-hbase6:43045] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:43045 2023-02-07 19:03:21,758 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,43045,1675796598090 2023-02-07 19:03:21,758 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:21,758 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cc39004 rejected from java.util.concurrent.ThreadPoolExecutor@18fc1744[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,761 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,43045,1675796598090] 2023-02-07 19:03:21,761 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,43045,1675796598090; numProcessing=2 2023-02-07 19:03:21,762 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,43045,1675796598090 already deleted, retry=false 2023-02-07 19:03:21,762 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,43045,1675796598090 expired; onlineServers=0 2023-02-07 19:03:21,762 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,43131,1675796598041' ***** 2023-02-07 19:03:21,762 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:21,763 DEBUG [M:0;jenkins-hbase6:43131] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@617c5f0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:21,763 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,43131,1675796598041 2023-02-07 19:03:21,763 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,43131,1675796598041; all regions closed. 2023-02-07 19:03:21,763 DEBUG [M:0;jenkins-hbase6:43131] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:21,763 DEBUG [M:0;jenkins-hbase6:43131] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:21,763 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:21,763 DEBUG [M:0;jenkins-hbase6:43131] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:21,763 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796598302] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796598302,5,FailOnTimeoutGroup] 2023-02-07 19:03:21,763 INFO [M:0;jenkins-hbase6:43131] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:21,763 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796598302] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796598302,5,FailOnTimeoutGroup] 2023-02-07 19:03:21,764 INFO [M:0;jenkins-hbase6:43131] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:21,764 INFO [M:0;jenkins-hbase6:43131] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:21,764 DEBUG [M:0;jenkins-hbase6:43131] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:21,764 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:21,764 INFO [M:0;jenkins-hbase6:43131] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:21,764 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:21,765 ERROR [M:0;jenkins-hbase6:43131] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 19:03:21,765 INFO [M:0;jenkins-hbase6:43131] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:21,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:21,765 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:21,765 DEBUG [M:0;jenkins-hbase6:43131] zookeeper.ZKUtil(398): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:21,765 WARN [M:0;jenkins-hbase6:43131] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:21,766 INFO [M:0;jenkins-hbase6:43131] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:21,766 INFO [M:0;jenkins-hbase6:43131] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:21,766 DEBUG [M:0;jenkins-hbase6:43131] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:21,766 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:21,766 DEBUG [M:0;jenkins-hbase6:43131] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:21,766 DEBUG [M:0;jenkins-hbase6:43131] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:21,766 DEBUG [M:0;jenkins-hbase6:43131] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:21,766 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.92 KB heapSize=66.90 KB 2023-02-07 19:03:21,775 INFO [M:0;jenkins-hbase6:43131] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.92 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bd27f09944bd465597737fd215835a53 2023-02-07 19:03:21,779 DEBUG [M:0;jenkins-hbase6:43131] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bd27f09944bd465597737fd215835a53 as hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bd27f09944bd465597737fd215835a53 2023-02-07 19:03:21,783 INFO [M:0;jenkins-hbase6:43131] regionserver.HStore(1080): Added hdfs://localhost:44043/user/jenkins/test-data/74735b54-d714-b8e0-2453-74f565dedea4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bd27f09944bd465597737fd215835a53, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 19:03:21,784 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegion(2947): Finished flush of dataSize ~55.92 KB/57263, heapSize ~66.88 KB/68488, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-07 19:03:21,785 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:21,785 DEBUG [M:0;jenkins-hbase6:43131] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796601766Disabling compacts and flushes for region at 1675796601766Disabling writes for close at 1675796601766Obtaining lock to block concurrent updates at 1675796601767 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796601767Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57263, getHeapSize=68488, getOffHeapSize=0, getCellsCount=145 at 1675796601767Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796601767Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796601768 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796601770 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796601770Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796601779 (+9 ms)Finished flush of dataSize ~55.92 KB/57263, heapSize ~66.88 KB/68488, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675796601784 (+5 ms)Writing region close event to WAL at 1675796601785 (+1 ms)Closed at 1675796601785 2023-02-07 19:03:21,788 INFO [M:0;jenkins-hbase6:43131] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:21,788 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:21,788 INFO [M:0;jenkins-hbase6:43131] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:43131 2023-02-07 19:03:21,791 DEBUG [M:0;jenkins-hbase6:43131] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,43131,1675796598041 already deleted, retry=false 2023-02-07 19:03:21,861 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:21,861 INFO [RS:0;jenkins-hbase6:43045] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,43045,1675796598090; zookeeper connection closed. 2023-02-07 19:03:21,861 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6caaa868 rejected from java.util.concurrent.ThreadPoolExecutor@18fc1744[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,861 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): regionserver:43045-0x1013e9801490001, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:21,861 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14572aa7 rejected from java.util.concurrent.ThreadPoolExecutor@18fc1744[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,861 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a43a84e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a43a84e 2023-02-07 19:03:21,861 INFO [Listener at localhost/39319] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:21,961 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:21,961 INFO [M:0;jenkins-hbase6:43131] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,43131,1675796598041; zookeeper connection closed. 2023-02-07 19:03:21,961 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38e942dd rejected from java.util.concurrent.ThreadPoolExecutor@3cd6c118[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,962 DEBUG [Listener at localhost/39319-EventThread] zookeeper.ZKWatcher(600): master:43131-0x1013e9801490000, quorum=127.0.0.1:65187, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:21,962 WARN [Listener at localhost/39319] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:21,962 ERROR [Listener at localhost/39319-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a6ad05e rejected from java.util.concurrent.ThreadPoolExecutor@3cd6c118[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:21,967 INFO [Listener at localhost/39319] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:22,074 WARN [BP-7122355-172.31.2.20-1675796597286 heartbeating to localhost/127.0.0.1:44043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:22,074 WARN [BP-7122355-172.31.2.20-1675796597286 heartbeating to localhost/127.0.0.1:44043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-7122355-172.31.2.20-1675796597286 (Datanode Uuid 36ff3284-7a8f-4fa7-b0ed-3c70fcfaeaf2) service to localhost/127.0.0.1:44043 2023-02-07 19:03:22,074 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/dfs/data/data3/current/BP-7122355-172.31.2.20-1675796597286] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:22,075 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/dfs/data/data4/current/BP-7122355-172.31.2.20-1675796597286] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:22,076 WARN [Listener at localhost/39319] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:22,079 INFO [Listener at localhost/39319] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:22,185 WARN [BP-7122355-172.31.2.20-1675796597286 heartbeating to localhost/127.0.0.1:44043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:22,185 WARN [BP-7122355-172.31.2.20-1675796597286 heartbeating to localhost/127.0.0.1:44043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-7122355-172.31.2.20-1675796597286 (Datanode Uuid 8afb1692-074c-4570-93b8-2cc5492c92fb) service to localhost/127.0.0.1:44043 2023-02-07 19:03:22,186 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/dfs/data/data1/current/BP-7122355-172.31.2.20-1675796597286] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:22,186 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/cluster_4efb4b70-3434-bfd2-b6e7-2b46fb9a7586/dfs/data/data2/current/BP-7122355-172.31.2.20-1675796597286] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:22,196 INFO [Listener at localhost/39319] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:22,309 INFO [Listener at localhost/39319] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:22,329 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:22,342 INFO [Listener at localhost/39319] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 156) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44043 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39319 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44043 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:44043 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44043 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,43131,1675796598041)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44043 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:44043 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44043 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=576 (was 546) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 384), ProcessCount=169 (was 169), AvailableMemoryMB=4828 (was 4877) 2023-02-07 19:03:22,351 INFO [Listener at localhost/39319] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=576, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=169, AvailableMemoryMB=4828 2023-02-07 19:03:22,363 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/hadoop.log.dir so I do NOT create it in target/test-data/64955954-9512-f09a-22e6-d089d8222f7d 2023-02-07 19:03:22,363 WARN [Listener at localhost/39319] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 19:03:22,363 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/hadoop.tmp.dir so I do NOT create it in target/test-data/64955954-9512-f09a-22e6-d089d8222f7d 2023-02-07 19:03:22,363 WARN [Listener at localhost/39319] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a027e724-4a28-6317-c0e3-e0865e706cfb/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 19:03:22,363 DEBUG [Listener at localhost/39319] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d 2023-02-07 19:03:22,363 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:03:22,363 INFO [Listener at localhost/39319] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e, deleteOnExit=true 2023-02-07 19:03:22,363 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:03:22,364 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/test.cache.data in system properties and HBase conf 2023-02-07 19:03:22,364 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:03:22,364 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:03:22,364 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:03:22,364 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:03:22,364 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:03:22,365 DEBUG [Listener at localhost/39319] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:03:22,365 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:03:22,366 INFO [Listener at localhost/39319] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:03:22,370 WARN [Listener at localhost/39319] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:22,370 WARN [Listener at localhost/39319] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:22,412 WARN [Listener at localhost/39319] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:22,414 INFO [Listener at localhost/39319] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:22,420 INFO [Listener at localhost/39319] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/java.io.tmpdir/Jetty_localhost_36643_hdfs____.5odylg/webapp 2023-02-07 19:03:22,511 INFO [Listener at localhost/39319] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36643 2023-02-07 19:03:22,515 WARN [Listener at localhost/39319] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:22,516 WARN [Listener at localhost/39319] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:22,562 WARN [Listener at localhost/44889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:22,577 WARN [Listener at localhost/44889] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:22,579 WARN [Listener at localhost/44889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:22,580 INFO [Listener at localhost/44889] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:22,585 INFO [Listener at localhost/44889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/java.io.tmpdir/Jetty_localhost_42429_datanode____.zfxf8c/webapp 2023-02-07 19:03:22,676 INFO [Listener at localhost/44889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42429 2023-02-07 19:03:22,684 WARN [Listener at localhost/38033] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:22,707 WARN [Listener at localhost/38033] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:22,709 WARN [Listener at localhost/38033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:22,711 INFO [Listener at localhost/38033] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:22,716 INFO [Listener at localhost/38033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/java.io.tmpdir/Jetty_localhost_39017_datanode____ei3vo7/webapp 2023-02-07 19:03:22,784 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7d2e6769e85d8ef4: Processing first storage report for DS-6de99467-1f43-48e0-b160-38516f908253 from datanode f8bd856d-5873-43ce-90ff-8ddb32750e8d 2023-02-07 19:03:22,784 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7d2e6769e85d8ef4: from storage DS-6de99467-1f43-48e0-b160-38516f908253 node DatanodeRegistration(127.0.0.1:35881, datanodeUuid=f8bd856d-5873-43ce-90ff-8ddb32750e8d, infoPort=36773, infoSecurePort=0, ipcPort=38033, storageInfo=lv=-57;cid=testClusterID;nsid=1835017306;c=1675796602373), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:22,784 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7d2e6769e85d8ef4: Processing first storage report for DS-433ca939-2f23-4be7-b484-4dbfa4d4b81a from datanode f8bd856d-5873-43ce-90ff-8ddb32750e8d 2023-02-07 19:03:22,784 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7d2e6769e85d8ef4: from storage DS-433ca939-2f23-4be7-b484-4dbfa4d4b81a node DatanodeRegistration(127.0.0.1:35881, datanodeUuid=f8bd856d-5873-43ce-90ff-8ddb32750e8d, infoPort=36773, infoSecurePort=0, ipcPort=38033, storageInfo=lv=-57;cid=testClusterID;nsid=1835017306;c=1675796602373), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:22,814 INFO [Listener at localhost/38033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39017 2023-02-07 19:03:22,822 WARN [Listener at localhost/33873] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:22,989 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56eed078fdae06a0: Processing first storage report for DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc from datanode 38af3cbe-0d28-47f3-92e6-bf8e8aea12e4 2023-02-07 19:03:22,989 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56eed078fdae06a0: from storage DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc node DatanodeRegistration(127.0.0.1:46831, datanodeUuid=38af3cbe-0d28-47f3-92e6-bf8e8aea12e4, infoPort=38169, infoSecurePort=0, ipcPort=33873, storageInfo=lv=-57;cid=testClusterID;nsid=1835017306;c=1675796602373), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:22,989 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x56eed078fdae06a0: Processing first storage report for DS-2edb89f9-739d-492f-8d08-f692cdace017 from datanode 38af3cbe-0d28-47f3-92e6-bf8e8aea12e4 2023-02-07 19:03:22,989 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x56eed078fdae06a0: from storage DS-2edb89f9-739d-492f-8d08-f692cdace017 node DatanodeRegistration(127.0.0.1:46831, datanodeUuid=38af3cbe-0d28-47f3-92e6-bf8e8aea12e4, infoPort=38169, infoSecurePort=0, ipcPort=33873, storageInfo=lv=-57;cid=testClusterID;nsid=1835017306;c=1675796602373), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:23,034 DEBUG [Listener at localhost/33873] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d 2023-02-07 19:03:23,036 INFO [Listener at localhost/33873] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/zookeeper_0, clientPort=52948, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:03:23,037 INFO [Listener at localhost/33873] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52948 2023-02-07 19:03:23,037 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,038 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,051 INFO [Listener at localhost/33873] util.FSUtils(479): Created version file at hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d with version=8 2023-02-07 19:03:23,051 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,052 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,053 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/hbase-staging 2023-02-07 19:03:23,055 INFO [Listener at localhost/33873] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:23,055 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,055 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,055 INFO [Listener at localhost/33873] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:23,056 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,056 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:23,056 INFO [Listener at localhost/33873] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:23,056 INFO [Listener at localhost/33873] ipc.NettyRpcServer(120): Bind to /172.31.2.20:40849 2023-02-07 19:03:23,057 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,057 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,058 INFO [Listener at localhost/33873] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40849 connecting to ZooKeeper ensemble=127.0.0.1:52948 2023-02-07 19:03:23,065 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:408490x0, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:23,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40849-0x1013e9814e00000 connected 2023-02-07 19:03:23,082 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:23,082 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:23,082 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:23,083 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40849 2023-02-07 19:03:23,086 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40849 2023-02-07 19:03:23,086 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40849 2023-02-07 19:03:23,087 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40849 2023-02-07 19:03:23,087 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40849 2023-02-07 19:03:23,087 INFO [Listener at localhost/33873] master.HMaster(439): hbase.rootdir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d, hbase.cluster.distributed=false 2023-02-07 19:03:23,102 INFO [Listener at localhost/33873] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:23,102 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,103 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,103 INFO [Listener at localhost/33873] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:23,103 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,103 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:23,103 INFO [Listener at localhost/33873] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:23,104 INFO [Listener at localhost/33873] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39905 2023-02-07 19:03:23,104 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:23,105 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:23,105 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,106 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,107 INFO [Listener at localhost/33873] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39905 connecting to ZooKeeper ensemble=127.0.0.1:52948 2023-02-07 19:03:23,112 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:399050x0, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:23,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39905-0x1013e9814e00001 connected 2023-02-07 19:03:23,114 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:23,114 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:23,115 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:23,118 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39905 2023-02-07 19:03:23,119 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39905 2023-02-07 19:03:23,119 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39905 2023-02-07 19:03:23,121 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39905 2023-02-07 19:03:23,122 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39905 2023-02-07 19:03:23,133 INFO [Listener at localhost/33873] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:23,133 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,133 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,133 INFO [Listener at localhost/33873] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:23,146 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:23,146 INFO [Listener at localhost/33873] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:23,147 INFO [Listener at localhost/33873] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:23,171 INFO [Listener at localhost/33873] ipc.NettyRpcServer(120): Bind to /172.31.2.20:38215 2023-02-07 19:03:23,171 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:23,214 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:23,215 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,216 INFO [Listener at localhost/33873] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,217 INFO [Listener at localhost/33873] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38215 connecting to ZooKeeper ensemble=127.0.0.1:52948 2023-02-07 19:03:23,221 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:382150x0, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38215-0x1013e9814e00002 connected 2023-02-07 19:03:23,222 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:23,223 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:23,223 DEBUG [Listener at localhost/33873] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:23,223 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38215 2023-02-07 19:03:23,223 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38215 2023-02-07 19:03:23,224 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38215 2023-02-07 19:03:23,225 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38215 2023-02-07 19:03:23,226 DEBUG [Listener at localhost/33873] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38215 2023-02-07 19:03:23,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,229 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:23,229 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,232 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:23,232 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:23,232 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,232 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:23,233 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:23,234 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,40849,1675796603055 from backup master directory 2023-02-07 19:03:23,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:23,236 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,236 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:23,236 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:23,236 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,250 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/hbase.id with ID: dfbed10b-18a2-49a8-98c2-e0186e1d6d2f 2023-02-07 19:03:23,259 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:23,261 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,267 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x75c1796d to 127.0.0.1:52948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:23,271 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73712cc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:23,271 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:23,272 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:03:23,272 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:23,273 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store-tmp 2023-02-07 19:03:23,280 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:23,280 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:23,281 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:23,281 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:23,281 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:23,281 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:23,281 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:23,281 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796603280Disabling compacts and flushes for region at 1675796603280Disabling writes for close at 1675796603281 (+1 ms)Writing region close event to WAL at 1675796603281Closed at 1675796603281 2023-02-07 19:03:23,281 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/WALs/jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,284 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C40849%2C1675796603055, suffix=, logDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/WALs/jenkins-hbase6.apache.org,40849,1675796603055, archiveDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/oldWALs, maxLogs=10 2023-02-07 19:03:23,299 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK] 2023-02-07 19:03:23,299 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK] 2023-02-07 19:03:23,301 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/WALs/jenkins-hbase6.apache.org,40849,1675796603055/jenkins-hbase6.apache.org%2C40849%2C1675796603055.1675796603284 2023-02-07 19:03:23,301 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK], DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK]] 2023-02-07 19:03:23,301 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:23,302 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:23,302 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:23,302 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:23,303 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:23,304 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:03:23,304 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:03:23,304 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,305 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:23,305 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:23,308 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:23,309 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:23,310 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72690969, jitterRate=0.08317984640598297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:23,310 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796603302Initializing all the Stores at 1675796603302Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796603303 (+1 ms)Cleaning up temporary data from old regions at 1675796603306 (+3 ms)Cleaning up detritus from prior splits at 1675796603306Region opened successfully at 1675796603310 (+4 ms) 2023-02-07 19:03:23,310 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:03:23,311 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:03:23,311 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:03:23,311 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:03:23,312 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 19:03:23,312 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 19:03:23,312 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:03:23,313 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:03:23,313 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:03:23,323 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:03:23,323 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:03:23,324 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:03:23,324 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:03:23,324 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:03:23,328 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,329 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:03:23,329 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:03:23,330 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:03:23,332 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:23,332 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:23,332 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:23,332 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,333 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,40849,1675796603055, sessionid=0x1013e9814e00000, setting cluster-up flag (Was=false) 2023-02-07 19:03:23,339 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,347 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:03:23,348 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,353 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,359 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:03:23,360 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:23,361 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.hbase-snapshot/.tmp 2023-02-07 19:03:23,362 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:23,363 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796633366 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:03:23,366 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:03:23,366 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:23,366 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:03:23,368 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:23,371 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,371 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:03:23,372 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:03:23,372 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:03:23,374 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:03:23,374 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:03:23,377 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796603374,5,FailOnTimeoutGroup] 2023-02-07 19:03:23,378 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796603377,5,FailOnTimeoutGroup] 2023-02-07 19:03:23,378 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,378 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:03:23,378 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,378 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,381 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:23,382 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:23,382 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d 2023-02-07 19:03:23,395 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:23,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:23,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/info 2023-02-07 19:03:23,398 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:23,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:23,400 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:23,401 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:23,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:23,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/table 2023-02-07 19:03:23,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:23,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,405 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740 2023-02-07 19:03:23,405 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740 2023-02-07 19:03:23,407 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:23,409 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:23,411 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:23,411 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66716624, jitterRate=-0.005844831466674805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:23,411 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796603395Initializing all the Stores at 1675796603396 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796603396Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796603396Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796603396Cleaning up temporary data from old regions at 1675796603406 (+10 ms)Cleaning up detritus from prior splits at 1675796603407 (+1 ms)Region opened successfully at 1675796603411 (+4 ms) 2023-02-07 19:03:23,411 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:23,411 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:23,411 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:23,412 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:23,412 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:23,412 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:23,412 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796603411Disabling compacts and flushes for region at 1675796603411Disabling writes for close at 1675796603412 (+1 ms)Writing region close event to WAL at 1675796603412Closed at 1675796603412 2023-02-07 19:03:23,413 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:23,413 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:03:23,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:03:23,415 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:03:23,416 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:03:23,428 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(952): ClusterId : dfbed10b-18a2-49a8-98c2-e0186e1d6d2f 2023-02-07 19:03:23,428 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(952): ClusterId : dfbed10b-18a2-49a8-98c2-e0186e1d6d2f 2023-02-07 19:03:23,428 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:23,429 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:23,431 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:23,432 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:23,432 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:23,432 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:23,434 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:23,435 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:23,436 DEBUG [RS:1;jenkins-hbase6:38215] zookeeper.ReadOnlyZKClient(139): Connect 0x54f45ef2 to 127.0.0.1:52948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:23,436 DEBUG [RS:0;jenkins-hbase6:39905] zookeeper.ReadOnlyZKClient(139): Connect 0x7900df2b to 127.0.0.1:52948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:23,444 DEBUG [RS:1;jenkins-hbase6:38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a33aa1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:23,444 DEBUG [RS:1;jenkins-hbase6:38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e0c3582, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:23,444 DEBUG [RS:0;jenkins-hbase6:39905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77c73e7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:23,445 DEBUG [RS:0;jenkins-hbase6:39905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f8b45b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:23,458 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:39905 2023-02-07 19:03:23,458 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:38215 2023-02-07 19:03:23,458 INFO [RS:0;jenkins-hbase6:39905] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:23,458 INFO [RS:0;jenkins-hbase6:39905] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:23,458 INFO [RS:1;jenkins-hbase6:38215] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:23,458 INFO [RS:1;jenkins-hbase6:38215] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:23,458 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:23,458 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:23,459 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,40849,1675796603055 with isa=jenkins-hbase6.apache.org/172.31.2.20:38215, startcode=1675796603132 2023-02-07 19:03:23,459 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,40849,1675796603055 with isa=jenkins-hbase6.apache.org/172.31.2.20:39905, startcode=1675796603102 2023-02-07 19:03:23,460 DEBUG [RS:1;jenkins-hbase6:38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:23,460 DEBUG [RS:0;jenkins-hbase6:39905] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:23,462 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41373, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:23,462 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42539, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:23,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40849] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,465 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d 2023-02-07 19:03:23,465 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d 2023-02-07 19:03:23,465 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44889 2023-02-07 19:03:23,465 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44889 2023-02-07 19:03:23,465 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:23,465 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:23,470 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:23,470 DEBUG [RS:0;jenkins-hbase6:39905] zookeeper.ZKUtil(162): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,470 DEBUG [RS:1;jenkins-hbase6:38215] zookeeper.ZKUtil(162): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,471 WARN [RS:0;jenkins-hbase6:39905] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:23,471 WARN [RS:1;jenkins-hbase6:38215] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:23,471 INFO [RS:0;jenkins-hbase6:39905] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:23,471 INFO [RS:1;jenkins-hbase6:38215] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:23,471 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,471 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,471 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,38215,1675796603132] 2023-02-07 19:03:23,471 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,39905,1675796603102] 2023-02-07 19:03:23,477 DEBUG [RS:1;jenkins-hbase6:38215] zookeeper.ZKUtil(162): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,477 DEBUG [RS:1;jenkins-hbase6:38215] zookeeper.ZKUtil(162): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,477 DEBUG [RS:0;jenkins-hbase6:39905] zookeeper.ZKUtil(162): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,481 DEBUG [RS:0;jenkins-hbase6:39905] zookeeper.ZKUtil(162): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,481 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:23,481 INFO [RS:1;jenkins-hbase6:38215] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:23,481 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:23,483 INFO [RS:0;jenkins-hbase6:39905] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:23,486 INFO [RS:1;jenkins-hbase6:38215] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:23,486 INFO [RS:0;jenkins-hbase6:39905] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:23,490 INFO [RS:1;jenkins-hbase6:38215] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:23,490 INFO [RS:0;jenkins-hbase6:39905] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:23,490 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,491 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,491 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:23,492 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:23,493 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,493 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,493 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,493 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,493 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,493 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,493 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:0;jenkins-hbase6:39905] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,494 DEBUG [RS:1;jenkins-hbase6:38215] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:23,498 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,502 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,502 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,502 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,503 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,503 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,513 INFO [RS:0;jenkins-hbase6:39905] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:23,513 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39905,1675796603102-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,517 INFO [RS:1;jenkins-hbase6:38215] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:23,517 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38215,1675796603132-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,527 INFO [RS:0;jenkins-hbase6:39905] regionserver.Replication(203): jenkins-hbase6.apache.org,39905,1675796603102 started 2023-02-07 19:03:23,527 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,39905,1675796603102, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:39905, sessionid=0x1013e9814e00001 2023-02-07 19:03:23,527 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:23,527 DEBUG [RS:0;jenkins-hbase6:39905] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,527 DEBUG [RS:0;jenkins-hbase6:39905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39905,1675796603102' 2023-02-07 19:03:23,527 DEBUG [RS:0;jenkins-hbase6:39905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:23,528 DEBUG [RS:0;jenkins-hbase6:39905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:23,528 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:23,528 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:23,528 DEBUG [RS:0;jenkins-hbase6:39905] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,528 DEBUG [RS:0;jenkins-hbase6:39905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39905,1675796603102' 2023-02-07 19:03:23,528 DEBUG [RS:0;jenkins-hbase6:39905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:23,529 DEBUG [RS:0;jenkins-hbase6:39905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:23,529 DEBUG [RS:0;jenkins-hbase6:39905] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:23,529 INFO [RS:0;jenkins-hbase6:39905] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:23,529 INFO [RS:0;jenkins-hbase6:39905] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:23,531 INFO [RS:1;jenkins-hbase6:38215] regionserver.Replication(203): jenkins-hbase6.apache.org,38215,1675796603132 started 2023-02-07 19:03:23,531 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,38215,1675796603132, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:38215, sessionid=0x1013e9814e00002 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,38215,1675796603132' 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,38215,1675796603132' 2023-02-07 19:03:23,532 DEBUG [RS:1;jenkins-hbase6:38215] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:23,533 DEBUG [RS:1;jenkins-hbase6:38215] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:23,533 DEBUG [RS:1;jenkins-hbase6:38215] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:23,533 INFO [RS:1;jenkins-hbase6:38215] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:23,533 INFO [RS:1;jenkins-hbase6:38215] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:23,566 DEBUG [jenkins-hbase6:40849] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:03:23,566 DEBUG [jenkins-hbase6:40849] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:23,568 DEBUG [jenkins-hbase6:40849] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:23,568 DEBUG [jenkins-hbase6:40849] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:23,568 DEBUG [jenkins-hbase6:40849] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:23,569 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39905,1675796603102, state=OPENING 2023-02-07 19:03:23,571 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:03:23,572 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:23,573 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:23,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:23,727 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:23,727 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:23,729 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:32840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:23,733 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:03:23,733 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:23,735 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39905%2C1675796603102.meta, suffix=.meta, logDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,39905,1675796603102, archiveDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/oldWALs, maxLogs=32 2023-02-07 19:03:23,794 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK] 2023-02-07 19:03:23,794 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK] 2023-02-07 19:03:23,799 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,39905,1675796603102/jenkins-hbase6.apache.org%2C39905%2C1675796603102.meta.1675796603735.meta 2023-02-07 19:03:23,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK], DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK]] 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:03:23,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:03:23,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:03:23,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:23,802 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/info 2023-02-07 19:03:23,802 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/info 2023-02-07 19:03:23,803 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:23,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,803 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:23,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:23,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:23,804 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:23,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:23,805 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/table 2023-02-07 19:03:23,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/table 2023-02-07 19:03:23,806 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:23,806 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:23,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740 2023-02-07 19:03:23,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740 2023-02-07 19:03:23,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:23,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:23,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62823470, jitterRate=-0.06385734677314758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:23,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796603800Writing region info on filesystem at 1675796603800Initializing all the Stores at 1675796603801 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796603801Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796603801Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796603801Cleaning up temporary data from old regions at 1675796603808 (+7 ms)Cleaning up detritus from prior splits at 1675796603809 (+1 ms)Running coprocessor post-open hooks at 1675796603811 (+2 ms)Region opened successfully at 1675796603811 2023-02-07 19:03:23,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796603727 2023-02-07 19:03:23,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:03:23,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:03:23,816 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39905,1675796603102, state=OPEN 2023-02-07 19:03:23,823 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:03:23,823 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:23,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:03:23,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39905,1675796603102 in 250 msec 2023-02-07 19:03:23,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:03:23,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 412 msec 2023-02-07 19:03:23,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 464 msec 2023-02-07 19:03:23,827 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796603229, completionTime=-1 2023-02-07 19:03:23,827 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:03:23,827 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:03:23,830 DEBUG [hconnection-0xdfc6497-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:23,831 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:32842, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:23,833 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:03:23,833 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796663833 2023-02-07 19:03:23,833 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796723833 2023-02-07 19:03:23,833 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40849,1675796603055-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40849,1675796603055-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40849,1675796603055-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:40849, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:03:23,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:23,841 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:03:23,842 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:03:23,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:23,843 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:23,844 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:23,845 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1 empty. 2023-02-07 19:03:23,845 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:23,845 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:03:23,857 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:23,858 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ed67c41b811c3dbe55461d0799384ce1, NAME => 'hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:23,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:23,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ed67c41b811c3dbe55461d0799384ce1, disabling compactions & flushes 2023-02-07 19:03:23,871 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:23,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:23,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. after waiting 0 ms 2023-02-07 19:03:23,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:23,871 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:23,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ed67c41b811c3dbe55461d0799384ce1: Waiting for close lock at 1675796603871Disabling compacts and flushes for region at 1675796603871Disabling writes for close at 1675796603871Writing region close event to WAL at 1675796603871Closed at 1675796603871 2023-02-07 19:03:23,873 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:23,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796603874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796603874"}]},"ts":"1675796603874"} 2023-02-07 19:03:23,876 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:23,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:23,877 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796603877"}]},"ts":"1675796603877"} 2023-02-07 19:03:23,878 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:03:23,883 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:23,884 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:23,884 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:23,884 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:23,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ed67c41b811c3dbe55461d0799384ce1, ASSIGN}] 2023-02-07 19:03:23,890 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ed67c41b811c3dbe55461d0799384ce1, ASSIGN 2023-02-07 19:03:23,891 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ed67c41b811c3dbe55461d0799384ce1, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38215,1675796603132; forceNewPlan=false, retain=false 2023-02-07 19:03:24,041 INFO [jenkins-hbase6:40849] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:24,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ed67c41b811c3dbe55461d0799384ce1, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796604042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604042"}]},"ts":"1675796604042"} 2023-02-07 19:03:24,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ed67c41b811c3dbe55461d0799384ce1, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:24,175 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 19:03:24,197 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,197 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:24,203 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47262, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:24,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:24,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C38215%2C1675796603132, suffix=, logDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,38215,1675796603132, archiveDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/oldWALs, maxLogs=32 2023-02-07 19:03:24,236 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK] 2023-02-07 19:03:24,236 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK] 2023-02-07 19:03:24,244 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,38215,1675796603132/jenkins-hbase6.apache.org%2C38215%2C1675796603132.1675796604214 2023-02-07 19:03:24,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK], DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK]] 2023-02-07 19:03:24,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ed67c41b811c3dbe55461d0799384ce1, NAME => 'hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:24,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,247 INFO [StoreOpener-ed67c41b811c3dbe55461d0799384ce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,249 DEBUG [StoreOpener-ed67c41b811c3dbe55461d0799384ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/info 2023-02-07 19:03:24,249 DEBUG [StoreOpener-ed67c41b811c3dbe55461d0799384ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/info 2023-02-07 19:03:24,249 INFO [StoreOpener-ed67c41b811c3dbe55461d0799384ce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed67c41b811c3dbe55461d0799384ce1 columnFamilyName info 2023-02-07 19:03:24,250 INFO [StoreOpener-ed67c41b811c3dbe55461d0799384ce1-1] regionserver.HStore(310): Store=ed67c41b811c3dbe55461d0799384ce1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:24,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,260 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened ed67c41b811c3dbe55461d0799384ce1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67665411, jitterRate=0.008293196558952332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:24,260 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for ed67c41b811c3dbe55461d0799384ce1: Running coprocessor pre-open hook at 1675796604245Writing region info on filesystem at 1675796604245Initializing all the Stores at 1675796604246 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796604246Cleaning up temporary data from old regions at 1675796604252 (+6 ms)Cleaning up detritus from prior splits at 1675796604253 (+1 ms)Running coprocessor post-open hooks at 1675796604260 (+7 ms)Region opened successfully at 1675796604260 2023-02-07 19:03:24,262 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1., pid=6, masterSystemTime=1675796604197 2023-02-07 19:03:24,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:24,266 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:24,267 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ed67c41b811c3dbe55461d0799384ce1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,267 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796604267"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604267"}]},"ts":"1675796604267"} 2023-02-07 19:03:24,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:03:24,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ed67c41b811c3dbe55461d0799384ce1, server=jenkins-hbase6.apache.org,38215,1675796603132 in 225 msec 2023-02-07 19:03:24,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:03:24,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ed67c41b811c3dbe55461d0799384ce1, ASSIGN in 386 msec 2023-02-07 19:03:24,272 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:24,273 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796604272"}]},"ts":"1675796604272"} 2023-02-07 19:03:24,274 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:03:24,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:24,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 436 msec 2023-02-07 19:03:24,344 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:03:24,345 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:24,345 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:24,348 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:24,349 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:24,351 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:03:24,359 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:24,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-07 19:03:24,372 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:03:24,379 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:24,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 19:03:24,390 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:03:24,392 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:03:24,392 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.156sec 2023-02-07 19:03:24,393 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:03:24,393 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:03:24,393 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:03:24,393 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40849,1675796603055-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:03:24,393 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40849,1675796603055-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:03:24,394 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:03:24,429 DEBUG [Listener at localhost/33873] zookeeper.ReadOnlyZKClient(139): Connect 0x74c057b3 to 127.0.0.1:52948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:24,434 DEBUG [Listener at localhost/33873] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e4e1fc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:24,435 DEBUG [hconnection-0x759c6f7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:24,437 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:32850, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:24,438 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:24,439 DEBUG [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:03:24,439 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:24,439 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:24,440 DEBUG [Listener at localhost/33873] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:03:24,443 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:49310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:03:24,444 INFO [Listener at localhost/33873] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-07 19:03:24,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceMultiRegion 2023-02-07 19:03:24,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:03:24,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.2.20:49310 deadline: 1675796664444, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-07 19:03:24,445 INFO [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-07 19:03:24,445 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:24,445 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:24,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:24,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:24,449 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:24,449 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-07 19:03:24,450 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:24,450 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:24,450 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:24,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,457 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac empty. 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 empty. 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d empty. 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d empty. 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,460 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-07 19:03:24,469 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:24,470 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => bdf8583c738309b11b6482051ba12cac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,470 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => c047b9d1f3594864142b8c14ceb7fcc0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,470 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 39b48234deadf1be3f1db960ae42cc4f, NAME => 'testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,481 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,481 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing c047b9d1f3594864142b8c14ceb7fcc0, disabling compactions & flushes 2023-02-07 19:03:24,481 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,481 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,481 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. after waiting 0 ms 2023-02-07 19:03:24,481 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,481 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,481 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for c047b9d1f3594864142b8c14ceb7fcc0: Waiting for close lock at 1675796604481Disabling compacts and flushes for region at 1675796604481Disabling writes for close at 1675796604481Writing region close event to WAL at 1675796604481Closed at 1675796604481 2023-02-07 19:03:24,482 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => fa838629f0b995cf210d0cf657d72403, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 39b48234deadf1be3f1db960ae42cc4f, disabling compactions & flushes 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing bdf8583c738309b11b6482051ba12cac, disabling compactions & flushes 2023-02-07 19:03:24,482 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,482 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. after waiting 0 ms 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. after waiting 0 ms 2023-02-07 19:03:24,482 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,482 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 39b48234deadf1be3f1db960ae42cc4f: Waiting for close lock at 1675796604482Disabling compacts and flushes for region at 1675796604482Disabling writes for close at 1675796604482Writing region close event to WAL at 1675796604482Closed at 1675796604482 2023-02-07 19:03:24,483 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,483 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for bdf8583c738309b11b6482051ba12cac: Waiting for close lock at 1675796604482Disabling compacts and flushes for region at 1675796604482Disabling writes for close at 1675796604482Writing region close event to WAL at 1675796604483 (+1 ms)Closed at 1675796604483 2023-02-07 19:03:24,483 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c26d5c15bc003874209d12daf85c0ecf, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,483 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0a1282db6180e4378a3c2c8042c3b000, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing fa838629f0b995cf210d0cf657d72403, disabling compactions & flushes 2023-02-07 19:03:24,497 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. after waiting 0 ms 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,497 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 0a1282db6180e4378a3c2c8042c3b000, disabling compactions & flushes 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for fa838629f0b995cf210d0cf657d72403: Waiting for close lock at 1675796604497Disabling compacts and flushes for region at 1675796604497Disabling writes for close at 1675796604497Writing region close event to WAL at 1675796604497Closed at 1675796604497 2023-02-07 19:03:24,497 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. after waiting 0 ms 2023-02-07 19:03:24,497 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,497 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,497 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => daf3207a7c51268a4e55f4c6725ccbb5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,498 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 0a1282db6180e4378a3c2c8042c3b000: Waiting for close lock at 1675796604497Disabling compacts and flushes for region at 1675796604497Disabling writes for close at 1675796604497Writing region close event to WAL at 1675796604497Closed at 1675796604497 2023-02-07 19:03:24,498 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9893dbb18eb205f10a4fe4ea091d7ba4, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,499 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,499 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing c26d5c15bc003874209d12daf85c0ecf, disabling compactions & flushes 2023-02-07 19:03:24,499 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,499 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,499 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. after waiting 0 ms 2023-02-07 19:03:24,499 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,499 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,499 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for c26d5c15bc003874209d12daf85c0ecf: Waiting for close lock at 1675796604499Disabling compacts and flushes for region at 1675796604499Disabling writes for close at 1675796604499Writing region close event to WAL at 1675796604499Closed at 1675796604499 2023-02-07 19:03:24,500 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => d40ee3354df51986b3e8ae536d1c3d7d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,515 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,515 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing daf3207a7c51268a4e55f4c6725ccbb5, disabling compactions & flushes 2023-02-07 19:03:24,515 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,515 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,515 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. after waiting 0 ms 2023-02-07 19:03:24,515 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,515 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for daf3207a7c51268a4e55f4c6725ccbb5: Waiting for close lock at 1675796604515Disabling compacts and flushes for region at 1675796604515Disabling writes for close at 1675796604515Writing region close event to WAL at 1675796604515Closed at 1675796604515 2023-02-07 19:03:24,516 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 789c6678a6e90e3be1c5e0c9820bc03d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 9893dbb18eb205f10a4fe4ea091d7ba4, disabling compactions & flushes 2023-02-07 19:03:24,516 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. after waiting 0 ms 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,516 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,516 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 9893dbb18eb205f10a4fe4ea091d7ba4: Waiting for close lock at 1675796604516Disabling compacts and flushes for region at 1675796604516Disabling writes for close at 1675796604516Writing region close event to WAL at 1675796604516Closed at 1675796604516 2023-02-07 19:03:24,519 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,519 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing d40ee3354df51986b3e8ae536d1c3d7d, disabling compactions & flushes 2023-02-07 19:03:24,519 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,520 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,520 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. after waiting 0 ms 2023-02-07 19:03:24,520 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,520 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,520 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for d40ee3354df51986b3e8ae536d1c3d7d: Waiting for close lock at 1675796604519Disabling compacts and flushes for region at 1675796604519Disabling writes for close at 1675796604520 (+1 ms)Writing region close event to WAL at 1675796604520Closed at 1675796604520 2023-02-07 19:03:24,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,522 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 789c6678a6e90e3be1c5e0c9820bc03d, disabling compactions & flushes 2023-02-07 19:03:24,523 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,523 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,523 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. after waiting 0 ms 2023-02-07 19:03:24,523 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,523 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,523 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 789c6678a6e90e3be1c5e0c9820bc03d: Waiting for close lock at 1675796604522Disabling compacts and flushes for region at 1675796604522Disabling writes for close at 1675796604523 (+1 ms)Writing region close event to WAL at 1675796604523Closed at 1675796604523 2023-02-07 19:03:24,525 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:24,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796604526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796604526"}]},"ts":"1675796604526"} 2023-02-07 19:03:24,529 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 19:03:24,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:24,530 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796604530"}]},"ts":"1675796604530"} 2023-02-07 19:03:24,531 INFO [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39905%2C1675796603102, suffix=, logDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,39905,1675796603102, archiveDir=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/oldWALs, maxLogs=32 2023-02-07 19:03:24,531 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-07 19:03:24,536 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:24,542 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:24,542 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:24,542 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:24,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, ASSIGN}] 2023-02-07 19:03:24,545 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, ASSIGN 2023-02-07 19:03:24,545 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, ASSIGN 2023-02-07 19:03:24,545 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, ASSIGN 2023-02-07 19:03:24,546 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, ASSIGN 2023-02-07 19:03:24,546 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38215,1675796603132; forceNewPlan=false, retain=false 2023-02-07 19:03:24,546 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39905,1675796603102; forceNewPlan=false, retain=false 2023-02-07 19:03:24,546 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38215,1675796603132; forceNewPlan=false, retain=false 2023-02-07 19:03:24,546 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK] 2023-02-07 19:03:24,547 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK] 2023-02-07 19:03:24,547 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39905,1675796603102; forceNewPlan=false, retain=false 2023-02-07 19:03:24,547 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, ASSIGN 2023-02-07 19:03:24,549 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, ASSIGN 2023-02-07 19:03:24,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, ASSIGN 2023-02-07 19:03:24,549 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38215,1675796603132; forceNewPlan=false, retain=false 2023-02-07 19:03:24,549 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, ASSIGN 2023-02-07 19:03:24,549 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, ASSIGN 2023-02-07 19:03:24,550 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39905,1675796603102; forceNewPlan=false, retain=false 2023-02-07 19:03:24,550 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38215,1675796603132; forceNewPlan=false, retain=false 2023-02-07 19:03:24,550 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39905,1675796603102; forceNewPlan=false, retain=false 2023-02-07 19:03:24,550 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, ASSIGN 2023-02-07 19:03:24,550 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39905,1675796603102; forceNewPlan=false, retain=false 2023-02-07 19:03:24,550 INFO [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,39905,1675796603102/jenkins-hbase6.apache.org%2C39905%2C1675796603102.1675796604531 2023-02-07 19:03:24,550 DEBUG [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46831,DS-199eb2a5-8b98-497f-bfc5-4d1350e885fc,DISK], DatanodeInfoWithStorage[127.0.0.1:35881,DS-6de99467-1f43-48e0-b160-38516f908253,DISK]] 2023-02-07 19:03:24,551 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:24,551 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:24,552 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38215,1675796603132; forceNewPlan=false, retain=false 2023-02-07 19:03:24,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:24,697 INFO [jenkins-hbase6:40849] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 19:03:24,703 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c047b9d1f3594864142b8c14ceb7fcc0, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,703 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=daf3207a7c51268a4e55f4c6725ccbb5, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d40ee3354df51986b3e8ae536d1c3d7d, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,703 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bdf8583c738309b11b6482051ba12cac, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604703"}]},"ts":"1675796604703"} 2023-02-07 19:03:24,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0a1282db6180e4378a3c2c8042c3b000, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,703 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604703"}]},"ts":"1675796604703"} 2023-02-07 19:03:24,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604703"}]},"ts":"1675796604703"} 2023-02-07 19:03:24,703 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604703"}]},"ts":"1675796604703"} 2023-02-07 19:03:24,703 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604703"}]},"ts":"1675796604703"} 2023-02-07 19:03:24,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure d40ee3354df51986b3e8ae536d1c3d7d, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:24,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure bdf8583c738309b11b6482051ba12cac, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:24,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure 0a1282db6180e4378a3c2c8042c3b000, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:24,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure daf3207a7c51268a4e55f4c6725ccbb5, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:24,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure c047b9d1f3594864142b8c14ceb7fcc0, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:24,708 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c26d5c15bc003874209d12daf85c0ecf, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,708 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604708"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604708"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604708"}]},"ts":"1675796604708"} 2023-02-07 19:03:24,708 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=789c6678a6e90e3be1c5e0c9820bc03d, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,709 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796604708"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604708"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604708"}]},"ts":"1675796604708"} 2023-02-07 19:03:24,710 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=39b48234deadf1be3f1db960ae42cc4f, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,710 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9893dbb18eb205f10a4fe4ea091d7ba4, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,710 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796604710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604710"}]},"ts":"1675796604710"} 2023-02-07 19:03:24,710 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604710"}]},"ts":"1675796604710"} 2023-02-07 19:03:24,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure c26d5c15bc003874209d12daf85c0ecf, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:24,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fa838629f0b995cf210d0cf657d72403, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,711 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796604711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796604711"}]},"ts":"1675796604711"} 2023-02-07 19:03:24,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 789c6678a6e90e3be1c5e0c9820bc03d, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:24,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure 39b48234deadf1be3f1db960ae42cc4f, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:24,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 9893dbb18eb205f10a4fe4ea091d7ba4, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:24,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure fa838629f0b995cf210d0cf657d72403, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:24,753 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:24,753 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:24,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:24,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0a1282db6180e4378a3c2c8042c3b000, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 19:03:24,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,862 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,863 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1 2023-02-07 19:03:24,863 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1 2023-02-07 19:03:24,864 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a1282db6180e4378a3c2c8042c3b000 columnFamilyName f1 2023-02-07 19:03:24,864 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(310): Store=0a1282db6180e4378a3c2c8042c3b000/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,864 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9893dbb18eb205f10a4fe4ea091d7ba4, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 19:03:24,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,865 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2 2023-02-07 19:03:24,865 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2 2023-02-07 19:03:24,866 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a1282db6180e4378a3c2c8042c3b000 columnFamilyName f2 2023-02-07 19:03:24,866 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,866 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(310): Store=0a1282db6180e4378a3c2c8042c3b000/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,867 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1 2023-02-07 19:03:24,867 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1 2023-02-07 19:03:24,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,867 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9893dbb18eb205f10a4fe4ea091d7ba4 columnFamilyName f1 2023-02-07 19:03:24,867 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(310): Store=9893dbb18eb205f10a4fe4ea091d7ba4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,868 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,868 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2 2023-02-07 19:03:24,869 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2 2023-02-07 19:03:24,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,869 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9893dbb18eb205f10a4fe4ea091d7ba4 columnFamilyName f2 2023-02-07 19:03:24,869 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(310): Store=9893dbb18eb205f10a4fe4ea091d7ba4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:24,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 0a1282db6180e4378a3c2c8042c3b000; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68056912, jitterRate=0.014127016067504883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 0a1282db6180e4378a3c2c8042c3b000: Running coprocessor pre-open hook at 1675796604861Writing region info on filesystem at 1675796604861Initializing all the Stores at 1675796604861Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604862 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604862Cleaning up temporary data from old regions at 1675796604868 (+6 ms)Cleaning up detritus from prior splits at 1675796604868Running coprocessor post-open hooks at 1675796604872 (+4 ms)Region opened successfully at 1675796604872 2023-02-07 19:03:24,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:24,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000., pid=23, masterSystemTime=1675796604857 2023-02-07 19:03:24,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:24,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 9893dbb18eb205f10a4fe4ea091d7ba4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72621941, jitterRate=0.08215124905109406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,875 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0a1282db6180e4378a3c2c8042c3b000, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 9893dbb18eb205f10a4fe4ea091d7ba4: Running coprocessor pre-open hook at 1675796604865Writing region info on filesystem at 1675796604865Initializing all the Stores at 1675796604866 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604866Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604866Cleaning up temporary data from old regions at 1675796604871 (+5 ms)Cleaning up detritus from prior splits at 1675796604871Running coprocessor post-open hooks at 1675796604875 (+4 ms)Region opened successfully at 1675796604875 2023-02-07 19:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => daf3207a7c51268a4e55f4c6725ccbb5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 19:03:24,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604875"}]},"ts":"1675796604875"} 2023-02-07 19:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4., pid=29, masterSystemTime=1675796604862 2023-02-07 19:03:24,877 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:24,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 39b48234deadf1be3f1db960ae42cc4f, NAME => 'testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 19:03:24,877 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9893dbb18eb205f10a4fe4ea091d7ba4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,877 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604877"}]},"ts":"1675796604877"} 2023-02-07 19:03:24,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,878 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1 2023-02-07 19:03:24,878 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1 2023-02-07 19:03:24,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-07 19:03:24,878 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daf3207a7c51268a4e55f4c6725ccbb5 columnFamilyName f1 2023-02-07 19:03:24,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure 0a1282db6180e4378a3c2c8042c3b000, server=jenkins-hbase6.apache.org,39905,1675796603102 in 171 msec 2023-02-07 19:03:24,879 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(310): Store=daf3207a7c51268a4e55f4c6725ccbb5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,879 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, ASSIGN in 335 msec 2023-02-07 19:03:24,880 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2 2023-02-07 19:03:24,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-07 19:03:24,880 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2 2023-02-07 19:03:24,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 9893dbb18eb205f10a4fe4ea091d7ba4, server=jenkins-hbase6.apache.org,38215,1675796603132 in 167 msec 2023-02-07 19:03:24,881 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daf3207a7c51268a4e55f4c6725ccbb5 columnFamilyName f2 2023-02-07 19:03:24,881 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(310): Store=daf3207a7c51268a4e55f4c6725ccbb5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, ASSIGN in 337 msec 2023-02-07 19:03:24,883 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,884 DEBUG [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f1 2023-02-07 19:03:24,884 DEBUG [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f1 2023-02-07 19:03:24,885 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39b48234deadf1be3f1db960ae42cc4f columnFamilyName f1 2023-02-07 19:03:24,885 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(310): Store=39b48234deadf1be3f1db960ae42cc4f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,885 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,886 DEBUG [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f2 2023-02-07 19:03:24,886 DEBUG [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f2 2023-02-07 19:03:24,887 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39b48234deadf1be3f1db960ae42cc4f columnFamilyName f2 2023-02-07 19:03:24,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:24,887 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(310): Store=39b48234deadf1be3f1db960ae42cc4f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened daf3207a7c51268a4e55f4c6725ccbb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63765623, jitterRate=-0.04981817305088043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for daf3207a7c51268a4e55f4c6725ccbb5: Running coprocessor pre-open hook at 1675796604876Writing region info on filesystem at 1675796604876Initializing all the Stores at 1675796604876Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604876Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604877 (+1 ms)Cleaning up temporary data from old regions at 1675796604885 (+8 ms)Cleaning up detritus from prior splits at 1675796604885Running coprocessor post-open hooks at 1675796604889 (+4 ms)Region opened successfully at 1675796604889 2023-02-07 19:03:24,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5., pid=24, masterSystemTime=1675796604857 2023-02-07 19:03:24,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:24,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:24,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d40ee3354df51986b3e8ae536d1c3d7d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 19:03:24,891 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=daf3207a7c51268a4e55f4c6725ccbb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,891 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604891"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604891"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604891"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604891"}]},"ts":"1675796604891"} 2023-02-07 19:03:24,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,893 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 39b48234deadf1be3f1db960ae42cc4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68946126, jitterRate=0.027377337217330933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 39b48234deadf1be3f1db960ae42cc4f: Running coprocessor pre-open hook at 1675796604878Writing region info on filesystem at 1675796604878Initializing all the Stores at 1675796604879 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604879Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604883 (+4 ms)Cleaning up temporary data from old regions at 1675796604889 (+6 ms)Cleaning up detritus from prior splits at 1675796604889Running coprocessor post-open hooks at 1675796604893 (+4 ms)Region opened successfully at 1675796604893 2023-02-07 19:03:24,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f., pid=28, masterSystemTime=1675796604862 2023-02-07 19:03:24,894 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1 2023-02-07 19:03:24,894 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1 2023-02-07 19:03:24,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-07 19:03:24,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure daf3207a7c51268a4e55f4c6725ccbb5, server=jenkins-hbase6.apache.org,39905,1675796603102 in 186 msec 2023-02-07 19:03:24,894 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d40ee3354df51986b3e8ae536d1c3d7d columnFamilyName f1 2023-02-07 19:03:24,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:24,895 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(310): Store=d40ee3354df51986b3e8ae536d1c3d7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,895 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fa838629f0b995cf210d0cf657d72403, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 19:03:24,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, ASSIGN in 351 msec 2023-02-07 19:03:24,895 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=39b48234deadf1be3f1db960ae42cc4f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,895 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796604895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604895"}]},"ts":"1675796604895"} 2023-02-07 19:03:24,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,896 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2 2023-02-07 19:03:24,896 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2 2023-02-07 19:03:24,896 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d40ee3354df51986b3e8ae536d1c3d7d columnFamilyName f2 2023-02-07 19:03:24,897 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,897 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(310): Store=d40ee3354df51986b3e8ae536d1c3d7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-07 19:03:24,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure 39b48234deadf1be3f1db960ae42cc4f, server=jenkins-hbase6.apache.org,38215,1675796603132 in 185 msec 2023-02-07 19:03:24,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,898 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1 2023-02-07 19:03:24,898 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1 2023-02-07 19:03:24,899 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa838629f0b995cf210d0cf657d72403 columnFamilyName f1 2023-02-07 19:03:24,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, ASSIGN in 355 msec 2023-02-07 19:03:24,899 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(310): Store=fa838629f0b995cf210d0cf657d72403/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,899 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,900 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2 2023-02-07 19:03:24,900 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2 2023-02-07 19:03:24,900 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa838629f0b995cf210d0cf657d72403 columnFamilyName f2 2023-02-07 19:03:24,901 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(310): Store=fa838629f0b995cf210d0cf657d72403/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:24,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened d40ee3354df51986b3e8ae536d1c3d7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71056576, jitterRate=0.05882549285888672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for d40ee3354df51986b3e8ae536d1c3d7d: Running coprocessor pre-open hook at 1675796604892Writing region info on filesystem at 1675796604892Initializing all the Stores at 1675796604892Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604892Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604893 (+1 ms)Cleaning up temporary data from old regions at 1675796604899 (+6 ms)Cleaning up detritus from prior splits at 1675796604899Running coprocessor post-open hooks at 1675796604903 (+4 ms)Region opened successfully at 1675796604903 2023-02-07 19:03:24,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d., pid=21, masterSystemTime=1675796604857 2023-02-07 19:03:24,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:24,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bdf8583c738309b11b6482051ba12cac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 19:03:24,905 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d40ee3354df51986b3e8ae536d1c3d7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,905 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604905"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604905"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604905"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604905"}]},"ts":"1675796604905"} 2023-02-07 19:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened fa838629f0b995cf210d0cf657d72403; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66341257, jitterRate=-0.011438235640525818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for fa838629f0b995cf210d0cf657d72403: Running coprocessor pre-open hook at 1675796604896Writing region info on filesystem at 1675796604896Initializing all the Stores at 1675796604896Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604896Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604897 (+1 ms)Cleaning up temporary data from old regions at 1675796604902 (+5 ms)Cleaning up detritus from prior splits at 1675796604902Running coprocessor post-open hooks at 1675796604906 (+4 ms)Region opened successfully at 1675796604906 2023-02-07 19:03:24,906 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403., pid=30, masterSystemTime=1675796604862 2023-02-07 19:03:24,908 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1 2023-02-07 19:03:24,908 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1 2023-02-07 19:03:24,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-07 19:03:24,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure d40ee3354df51986b3e8ae536d1c3d7d, server=jenkins-hbase6.apache.org,39905,1675796603102 in 201 msec 2023-02-07 19:03:24,908 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdf8583c738309b11b6482051ba12cac columnFamilyName f1 2023-02-07 19:03:24,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:24,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 789c6678a6e90e3be1c5e0c9820bc03d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 19:03:24,908 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fa838629f0b995cf210d0cf657d72403, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604908"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604908"}]},"ts":"1675796604908"} 2023-02-07 19:03:24,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, ASSIGN in 365 msec 2023-02-07 19:03:24,910 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(310): Store=bdf8583c738309b11b6482051ba12cac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,910 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,912 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-07 19:03:24,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure fa838629f0b995cf210d0cf657d72403, server=jenkins-hbase6.apache.org,38215,1675796603132 in 197 msec 2023-02-07 19:03:24,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, ASSIGN in 369 msec 2023-02-07 19:03:24,921 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2 2023-02-07 19:03:24,922 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2 2023-02-07 19:03:24,922 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdf8583c738309b11b6482051ba12cac columnFamilyName f2 2023-02-07 19:03:24,922 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(310): Store=bdf8583c738309b11b6482051ba12cac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,922 DEBUG [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f1 2023-02-07 19:03:24,922 DEBUG [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f1 2023-02-07 19:03:24,923 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 789c6678a6e90e3be1c5e0c9820bc03d columnFamilyName f1 2023-02-07 19:03:24,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,923 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(310): Store=789c6678a6e90e3be1c5e0c9820bc03d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,923 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,925 DEBUG [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f2 2023-02-07 19:03:24,925 DEBUG [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f2 2023-02-07 19:03:24,925 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 789c6678a6e90e3be1c5e0c9820bc03d columnFamilyName f2 2023-02-07 19:03:24,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,926 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(310): Store=789c6678a6e90e3be1c5e0c9820bc03d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:24,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened bdf8583c738309b11b6482051ba12cac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64667489, jitterRate=-0.03637932240962982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for bdf8583c738309b11b6482051ba12cac: Running coprocessor pre-open hook at 1675796604905Writing region info on filesystem at 1675796604905Initializing all the Stores at 1675796604906 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604906Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604906Cleaning up temporary data from old regions at 1675796604924 (+18 ms)Cleaning up detritus from prior splits at 1675796604924Running coprocessor post-open hooks at 1675796604929 (+5 ms)Region opened successfully at 1675796604929 2023-02-07 19:03:24,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac., pid=22, masterSystemTime=1675796604857 2023-02-07 19:03:24,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:24,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:24,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c047b9d1f3594864142b8c14ceb7fcc0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 19:03:24,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,931 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bdf8583c738309b11b6482051ba12cac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,932 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604931"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604931"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604931"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604931"}]},"ts":"1675796604931"} 2023-02-07 19:03:24,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,933 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 789c6678a6e90e3be1c5e0c9820bc03d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64943672, jitterRate=-0.032263875007629395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 789c6678a6e90e3be1c5e0c9820bc03d: Running coprocessor pre-open hook at 1675796604909Writing region info on filesystem at 1675796604909Initializing all the Stores at 1675796604912 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604912Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604912Cleaning up temporary data from old regions at 1675796604927 (+15 ms)Cleaning up detritus from prior splits at 1675796604928 (+1 ms)Running coprocessor post-open hooks at 1675796604934 (+6 ms)Region opened successfully at 1675796604934 2023-02-07 19:03:24,934 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1 2023-02-07 19:03:24,934 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1 2023-02-07 19:03:24,935 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c047b9d1f3594864142b8c14ceb7fcc0 columnFamilyName f1 2023-02-07 19:03:24,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d., pid=27, masterSystemTime=1675796604862 2023-02-07 19:03:24,935 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(310): Store=c047b9d1f3594864142b8c14ceb7fcc0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-07 19:03:24,935 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure bdf8583c738309b11b6482051ba12cac, server=jenkins-hbase6.apache.org,39905,1675796603102 in 228 msec 2023-02-07 19:03:24,936 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2 2023-02-07 19:03:24,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,936 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2 2023-02-07 19:03:24,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:24,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, ASSIGN in 392 msec 2023-02-07 19:03:24,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c26d5c15bc003874209d12daf85c0ecf, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 19:03:24,937 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c047b9d1f3594864142b8c14ceb7fcc0 columnFamilyName f2 2023-02-07 19:03:24,937 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=789c6678a6e90e3be1c5e0c9820bc03d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,937 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796604937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604937"}]},"ts":"1675796604937"} 2023-02-07 19:03:24,937 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(310): Store=c047b9d1f3594864142b8c14ceb7fcc0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,938 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-07 19:03:24,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 789c6678a6e90e3be1c5e0c9820bc03d, server=jenkins-hbase6.apache.org,38215,1675796603132 in 227 msec 2023-02-07 19:03:24,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, ASSIGN in 397 msec 2023-02-07 19:03:24,943 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1 2023-02-07 19:03:24,943 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1 2023-02-07 19:03:24,943 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c26d5c15bc003874209d12daf85c0ecf columnFamilyName f1 2023-02-07 19:03:24,944 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(310): Store=c26d5c15bc003874209d12daf85c0ecf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,944 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:24,945 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2 2023-02-07 19:03:24,945 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2 2023-02-07 19:03:24,945 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c26d5c15bc003874209d12daf85c0ecf columnFamilyName f2 2023-02-07 19:03:24,946 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(310): Store=c26d5c15bc003874209d12daf85c0ecf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:24,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened c047b9d1f3594864142b8c14ceb7fcc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68179004, jitterRate=0.01594632863998413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for c047b9d1f3594864142b8c14ceb7fcc0: Running coprocessor pre-open hook at 1675796604932Writing region info on filesystem at 1675796604932Initializing all the Stores at 1675796604933 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604933Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604933Cleaning up temporary data from old regions at 1675796604943 (+10 ms)Cleaning up detritus from prior splits at 1675796604943Running coprocessor post-open hooks at 1675796604947 (+4 ms)Region opened successfully at 1675796604947 2023-02-07 19:03:24,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0., pid=25, masterSystemTime=1675796604857 2023-02-07 19:03:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:24,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c047b9d1f3594864142b8c14ceb7fcc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:24,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604949"}]},"ts":"1675796604949"} 2023-02-07 19:03:24,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:24,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:24,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-07 19:03:24,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure c047b9d1f3594864142b8c14ceb7fcc0, server=jenkins-hbase6.apache.org,39905,1675796603102 in 243 msec 2023-02-07 19:03:24,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened c26d5c15bc003874209d12daf85c0ecf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67952583, jitterRate=0.01257239282131195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:24,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for c26d5c15bc003874209d12daf85c0ecf: Running coprocessor pre-open hook at 1675796604937Writing region info on filesystem at 1675796604937Initializing all the Stores at 1675796604938 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604938Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796604938Cleaning up temporary data from old regions at 1675796604948 (+10 ms)Cleaning up detritus from prior splits at 1675796604948Running coprocessor post-open hooks at 1675796604952 (+4 ms)Region opened successfully at 1675796604952 2023-02-07 19:03:24,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, ASSIGN in 409 msec 2023-02-07 19:03:24,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf., pid=26, masterSystemTime=1675796604862 2023-02-07 19:03:24,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:24,954 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c26d5c15bc003874209d12daf85c0ecf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:24,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796604954"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796604954"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796604954"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796604954"}]},"ts":"1675796604954"} 2023-02-07 19:03:24,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-07 19:03:24,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure c26d5c15bc003874209d12daf85c0ecf, server=jenkins-hbase6.apache.org,38215,1675796603132 in 245 msec 2023-02-07 19:03:24,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-07 19:03:24,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, ASSIGN in 414 msec 2023-02-07 19:03:24,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:24,959 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796604959"}]},"ts":"1675796604959"} 2023-02-07 19:03:24,959 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-07 19:03:24,961 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:24,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 514 msec 2023-02-07 19:03:25,054 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:25,055 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:25,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:25,056 INFO [Listener at localhost/33873] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-07 19:03:25,056 DEBUG [Listener at localhost/33873] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-07 19:03:25,056 INFO [Listener at localhost/33873] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:25,059 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-07 19:03:25,059 INFO [Listener at localhost/33873] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:25,059 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-07 19:03:25,059 INFO [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:03:25,093 DEBUG [hconnection-0x759c6f7-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:25,099 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:25,105 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:25,113 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39905] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:25,177 INFO [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:03:25,178 INFO [Listener at localhost/33873] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:03:25,178 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:25,178 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:25,179 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 19:03:25,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796605179 (current time:1675796605179). 2023-02-07 19:03:25,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:03:25,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] zookeeper.ReadOnlyZKClient(139): Connect 0x150d2183 to 127.0.0.1:52948 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:25,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@781cac6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:25,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:25,187 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:32854, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:25,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x150d2183 to 127.0.0.1:52948 2023-02-07 19:03:25,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:25,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:03:25,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 19:03:25,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 19:03:25,191 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 19:03:25,192 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675797205192 2023-02-07 19:03:25,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 19:03:25,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,193 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:25,193 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:03:25,194 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 19:03:25,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 19:03:25,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-07 19:03:25,196 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 19:03:25,196 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675797205196 2023-02-07 19:03:25,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,208 INFO [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-07 19:03:25,208 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:25,209 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-07 19:03:25,209 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 19:03:25,209 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,209 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,211 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,211 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:25,211 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:25,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:25,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:25,211 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:25,211 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,212 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-07 19:03:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-07 19:03:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:25,214 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 19:03:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 19:03:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,38215,1675796603132' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 19:03:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 19:03:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 19:03:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39905,1675796603102' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 19:03:25,216 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,216 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:25,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:25,217 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,217 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,217 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,217 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:25,217 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,217 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,38215,1675796603132' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73219525[Count = 1] remaining members to acquire global barrier 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:25,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:25,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39905,1675796603102' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 19:03:25,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73219525[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:25,220 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 19:03:25,221 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 19:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,224 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,224 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. started... 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. started... 2023-02-07 19:03:25,225 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,226 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:25,226 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HRegion(2744): Flushing fa838629f0b995cf210d0cf657d72403 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:25,225 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 19:03:25,226 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:25,225 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9893dbb18eb205f10a4fe4ea091d7ba4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:25,225 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 19:03:25,226 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:25,225 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:25,226 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. started... 2023-02-07 19:03:25,226 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. started... 2023-02-07 19:03:25,226 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:25,228 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c26d5c15bc003874209d12daf85c0ecf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:25,228 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. started... 2023-02-07 19:03:25,228 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 0a1282db6180e4378a3c2c8042c3b000 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:25,226 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. started... 2023-02-07 19:03:25,229 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HRegion(2744): Flushing daf3207a7c51268a4e55f4c6725ccbb5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:25,229 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d40ee3354df51986b3e8ae536d1c3d7d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 19:03:25,254 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f1/955ace1484254f4bbba6795d61362ad9 2023-02-07 19:03:25,265 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f1/b407b73bb79c415c839eb6454269928d 2023-02-07 19:03:25,265 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f1/1ea3242cbe204db9b49139df66976a43 2023-02-07 19:03:25,279 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f1/2a48996a7ecc49369776d03f0c8d98fa 2023-02-07 19:03:25,280 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f1/027d2ab880134ee19f0ec9f5b5bcab03 2023-02-07 19:03:25,291 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f1/67a97b1cc1a04f44a1320fe12b940fc7 2023-02-07 19:03:25,302 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:25,302 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:25,302 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:25,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 19:03:25,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:25,317 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:03:25,319 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f2/7317c96b53264643b2cac88cdf26ff7a 2023-02-07 19:03:25,328 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f1/955ace1484254f4bbba6795d61362ad9 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/955ace1484254f4bbba6795d61362ad9 2023-02-07 19:03:25,333 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/955ace1484254f4bbba6795d61362ad9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,333 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f2/7317c96b53264643b2cac88cdf26ff7a as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/7317c96b53264643b2cac88cdf26ff7a 2023-02-07 19:03:25,338 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/7317c96b53264643b2cac88cdf26ff7a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,339 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0a1282db6180e4378a3c2c8042c3b000 in 112ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,339 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-07 19:03:25,340 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0a1282db6180e4378a3c2c8042c3b000: 2023-02-07 19:03:25,340 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,351 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,351 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/955ace1484254f4bbba6795d61362ad9] hfiles 2023-02-07 19:03:25,351 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/955ace1484254f4bbba6795d61362ad9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,351 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/7317c96b53264643b2cac88cdf26ff7a] hfiles 2023-02-07 19:03:25,351 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/7317c96b53264643b2cac88cdf26ff7a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,353 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f2/9056136757944035927de1c8323bbfda 2023-02-07 19:03:25,354 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f2/eb6e6fad3ba249b08a6dc8d42604eae9 2023-02-07 19:03:25,360 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f1/b407b73bb79c415c839eb6454269928d as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/b407b73bb79c415c839eb6454269928d 2023-02-07 19:03:25,364 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f2/6bd1673a03304984aab96dabb3bbbf55 2023-02-07 19:03:25,372 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f1/67a97b1cc1a04f44a1320fe12b940fc7 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/67a97b1cc1a04f44a1320fe12b940fc7 2023-02-07 19:03:25,374 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f2/98340c184e2d4fd89ec8a7b6b0e63626 2023-02-07 19:03:25,376 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f1/1ea3242cbe204db9b49139df66976a43 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/1ea3242cbe204db9b49139df66976a43 2023-02-07 19:03:25,376 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/67a97b1cc1a04f44a1320fe12b940fc7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,378 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f2/6bd1673a03304984aab96dabb3bbbf55 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/6bd1673a03304984aab96dabb3bbbf55 2023-02-07 19:03:25,383 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f2/57176193ea084ba3838f90b2819443a4 2023-02-07 19:03:25,387 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/6bd1673a03304984aab96dabb3bbbf55, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,387 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/1ea3242cbe204db9b49139df66976a43, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,388 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for daf3207a7c51268a4e55f4c6725ccbb5 in 159ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,388 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f2/9056136757944035927de1c8323bbfda as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/9056136757944035927de1c8323bbfda 2023-02-07 19:03:25,391 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for daf3207a7c51268a4e55f4c6725ccbb5: 2023-02-07 19:03:25,391 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,391 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,392 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/67a97b1cc1a04f44a1320fe12b940fc7] hfiles 2023-02-07 19:03:25,392 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/67a97b1cc1a04f44a1320fe12b940fc7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,392 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/6bd1673a03304984aab96dabb3bbbf55] hfiles 2023-02-07 19:03:25,392 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/6bd1673a03304984aab96dabb3bbbf55 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,393 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f1/027d2ab880134ee19f0ec9f5b5bcab03 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/027d2ab880134ee19f0ec9f5b5bcab03 2023-02-07 19:03:25,394 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/b407b73bb79c415c839eb6454269928d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,396 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f2/eb6e6fad3ba249b08a6dc8d42604eae9 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/eb6e6fad3ba249b08a6dc8d42604eae9 2023-02-07 19:03:25,397 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/9056136757944035927de1c8323bbfda, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,398 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c26d5c15bc003874209d12daf85c0ecf in 170ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,398 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c26d5c15bc003874209d12daf85c0ecf: 2023-02-07 19:03:25,398 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,399 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,399 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/1ea3242cbe204db9b49139df66976a43] hfiles 2023-02-07 19:03:25,399 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/1ea3242cbe204db9b49139df66976a43 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,399 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/9056136757944035927de1c8323bbfda] hfiles 2023-02-07 19:03:25,399 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/9056136757944035927de1c8323bbfda for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,401 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f1/2a48996a7ecc49369776d03f0c8d98fa as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/2a48996a7ecc49369776d03f0c8d98fa 2023-02-07 19:03:25,411 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/027d2ab880134ee19f0ec9f5b5bcab03, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:25,412 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f2/98340c184e2d4fd89ec8a7b6b0e63626 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/98340c184e2d4fd89ec8a7b6b0e63626 2023-02-07 19:03:25,413 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/2a48996a7ecc49369776d03f0c8d98fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,413 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/eb6e6fad3ba249b08a6dc8d42604eae9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,415 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f2/57176193ea084ba3838f90b2819443a4 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/57176193ea084ba3838f90b2819443a4 2023-02-07 19:03:25,416 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9893dbb18eb205f10a4fe4ea091d7ba4 in 191ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9893dbb18eb205f10a4fe4ea091d7ba4: 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/b407b73bb79c415c839eb6454269928d] hfiles 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/b407b73bb79c415c839eb6454269928d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/eb6e6fad3ba249b08a6dc8d42604eae9] hfiles 2023-02-07 19:03:25,417 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/eb6e6fad3ba249b08a6dc8d42604eae9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,428 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/98340c184e2d4fd89ec8a7b6b0e63626, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:25,429 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d40ee3354df51986b3e8ae536d1c3d7d in 200ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,429 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d40ee3354df51986b3e8ae536d1c3d7d: 2023-02-07 19:03:25,429 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,429 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,429 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/027d2ab880134ee19f0ec9f5b5bcab03] hfiles 2023-02-07 19:03:25,429 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/027d2ab880134ee19f0ec9f5b5bcab03 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,430 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/98340c184e2d4fd89ec8a7b6b0e63626] hfiles 2023-02-07 19:03:25,430 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/98340c184e2d4fd89ec8a7b6b0e63626 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,438 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. completed. 2023-02-07 19:03:25,439 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:25,439 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:25,439 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 19:03:25,439 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. started... 2023-02-07 19:03:25,441 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/57176193ea084ba3838f90b2819443a4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,442 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 789c6678a6e90e3be1c5e0c9820bc03d: 2023-02-07 19:03:25,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:25,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:25,443 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fa838629f0b995cf210d0cf657d72403 in 217ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for fa838629f0b995cf210d0cf657d72403: 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/2a48996a7ecc49369776d03f0c8d98fa] hfiles 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/2a48996a7ecc49369776d03f0c8d98fa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/57176193ea084ba3838f90b2819443a4] hfiles 2023-02-07 19:03:25,444 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/57176193ea084ba3838f90b2819443a4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,450 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. completed. 2023-02-07 19:03:25,450 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:25,451 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:25,451 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. started... 2023-02-07 19:03:25,451 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 19:03:25,458 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. completed. 2023-02-07 19:03:25,459 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:25,459 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:25,459 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 19:03:25,460 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c047b9d1f3594864142b8c14ceb7fcc0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 19:03:25,459 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. started... 2023-02-07 19:03:25,463 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 39b48234deadf1be3f1db960ae42cc4f: 2023-02-07 19:03:25,463 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,463 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,463 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:25,464 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 19:03:25,484 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. completed. 2023-02-07 19:03:25,484 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:25,484 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 19:03:25,487 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. completed. 2023-02-07 19:03:25,487 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:25,487 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 19:03:25,487 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f1/09aa70a095b44a18a2c71e051b771e6c 2023-02-07 19:03:25,500 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f2/3a06c1b5571e44d8ac9fa07455507e07 2023-02-07 19:03:25,505 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f1/09aa70a095b44a18a2c71e051b771e6c as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/09aa70a095b44a18a2c71e051b771e6c 2023-02-07 19:03:25,508 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/09aa70a095b44a18a2c71e051b771e6c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:25,509 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f2/3a06c1b5571e44d8ac9fa07455507e07 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/3a06c1b5571e44d8ac9fa07455507e07 2023-02-07 19:03:25,514 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/3a06c1b5571e44d8ac9fa07455507e07, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 19:03:25,515 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c047b9d1f3594864142b8c14ceb7fcc0 in 55ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,515 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c047b9d1f3594864142b8c14ceb7fcc0: 2023-02-07 19:03:25,515 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,515 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,515 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/09aa70a095b44a18a2c71e051b771e6c] hfiles 2023-02-07 19:03:25,516 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/09aa70a095b44a18a2c71e051b771e6c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,516 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/3a06c1b5571e44d8ac9fa07455507e07] hfiles 2023-02-07 19:03:25,516 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/3a06c1b5571e44d8ac9fa07455507e07 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,517 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:25,517 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:25,517 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:25,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 19:03:25,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:25,519 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 19:03:25,521 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. completed. 2023-02-07 19:03:25,521 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:25,521 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:25,521 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 19:03:25,522 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. started... 2023-02-07 19:03:25,523 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bdf8583c738309b11b6482051ba12cac 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 19:03:25,533 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f1/9a591b07279947beba6e02181634ad3b 2023-02-07 19:03:25,545 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f2/9c99e6590ddf4fd18b21a0bb0015286c 2023-02-07 19:03:25,549 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f1/9a591b07279947beba6e02181634ad3b as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/9a591b07279947beba6e02181634ad3b 2023-02-07 19:03:25,553 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/9a591b07279947beba6e02181634ad3b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,554 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f2/9c99e6590ddf4fd18b21a0bb0015286c as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/9c99e6590ddf4fd18b21a0bb0015286c 2023-02-07 19:03:25,558 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/9c99e6590ddf4fd18b21a0bb0015286c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 19:03:25,559 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bdf8583c738309b11b6482051ba12cac in 36ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bdf8583c738309b11b6482051ba12cac: 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/9a591b07279947beba6e02181634ad3b] hfiles 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/9a591b07279947beba6e02181634ad3b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/9c99e6590ddf4fd18b21a0bb0015286c] hfiles 2023-02-07 19:03:25,559 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/9c99e6590ddf4fd18b21a0bb0015286c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,568 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. completed. 2023-02-07 19:03:25,568 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:25,568 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 19:03:25,796 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. completed. 2023-02-07 19:03:25,796 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:25,796 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 19:03:25,819 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:25,819 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:25,819 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 19:03:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:25,820 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 19:03:25,824 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. completed. 2023-02-07 19:03:25,824 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:25,824 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 19:03:25,824 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 19:03:25,824 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,824 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 19:03:25,824 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,39905,1675796603102' in zk 2023-02-07 19:03:25,826 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,826 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 19:03:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:25,826 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:25,826 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 19:03:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,39905,1675796603102': 2023-02-07 19:03:25,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39905,1675796603102' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 19:03:25,873 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. completed. 2023-02-07 19:03:25,873 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:25,874 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 19:03:25,874 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 19:03:25,874 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,874 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 19:03:25,874 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,38215,1675796603132' in zk 2023-02-07 19:03:25,875 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 19:03:25,875 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,875 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:25,876 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 19:03:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,38215,1675796603132': 2023-02-07 19:03:25,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,38215,1675796603132' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:25,878 INFO [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-07 19:03:25,878 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:25,878 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:25,878 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,878 INFO [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:25,880 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:25,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:25,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,880 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:25,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:25,881 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:25,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,881 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,883 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:25,883 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:25,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:25,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:25,893 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:25,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:25,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:25,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,893 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,894 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:25,894 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,894 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:25,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:25,894 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,894 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-07 19:03:25,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,950 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:25,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675796605192Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675796605893 (+701 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675796605894 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1675796605903 (+9 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675796605913 (+10 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675796605949 (+36 ms) 2023-02-07 19:03:25,952 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 19:03:25,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 759 msec 2023-02-07 19:03:26,321 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:26,321 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:26,321 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:26,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 19:03:26,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:26,322 INFO [Listener at localhost/33873] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:26,322 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:26,323 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:26,326 INFO [Listener at localhost/33873] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:26,332 INFO [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:26,351 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,355 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39905] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,428 INFO [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:26,431 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:26,431 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:26,433 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,435 INFO [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-07 19:03:26,435 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:26,436 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-07 19:03:26,436 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 19:03:26,437 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,437 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,438 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:26,438 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:26,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:26,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:26,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:26,438 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:26,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,439 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,439 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,439 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,439 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,440 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-07 19:03:26,440 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:26,440 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-07 19:03:26,441 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:26,441 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 19:03:26,442 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 19:03:26,442 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:26,442 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. started... 2023-02-07 19:03:26,442 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:26,442 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:26,442 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d40ee3354df51986b3e8ae536d1c3d7d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 19:03:26,442 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. started... 2023-02-07 19:03:26,442 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. started... 2023-02-07 19:03:26,443 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0a1282db6180e4378a3c2c8042c3b000 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:26,443 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9893dbb18eb205f10a4fe4ea091d7ba4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:26,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. started... 2023-02-07 19:03:26,443 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 19:03:26,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:26,443 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fa838629f0b995cf210d0cf657d72403 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:26,443 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:26,443 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. started... 2023-02-07 19:03:26,444 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c26d5c15bc003874209d12daf85c0ecf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:26,444 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 19:03:26,444 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:26,445 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:26,445 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. started... 2023-02-07 19:03:26,445 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing daf3207a7c51268a4e55f4c6725ccbb5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:26,481 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f1/73d5aeae95c74d50aed4a7365ce0d63e 2023-02-07 19:03:26,481 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f1/7197fb77b9a54008af69783495f7cf4b 2023-02-07 19:03:26,481 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f1/408229011e5e4a66bc6b70be3447ff8c 2023-02-07 19:03:26,482 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f1/9c28b3bfbb0d48a6ad5272ff199fdab3 2023-02-07 19:03:26,486 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f1/f93022244a564146aec027b8a6594538 2023-02-07 19:03:26,486 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f1/db0cc0d592b6490d8dbb3473eade5838 2023-02-07 19:03:26,515 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f2/5f6a30c0549a4a2686de57e5c59f1fbc 2023-02-07 19:03:26,520 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f1/7197fb77b9a54008af69783495f7cf4b as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/7197fb77b9a54008af69783495f7cf4b 2023-02-07 19:03:26,526 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f2/81aeaab4bdb8464ebfda13ea07b3a7d0 2023-02-07 19:03:26,526 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f2/36575b7ca34a4aae8896a3f2d6ba1166 2023-02-07 19:03:26,530 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f1/73d5aeae95c74d50aed4a7365ce0d63e as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/73d5aeae95c74d50aed4a7365ce0d63e 2023-02-07 19:03:26,532 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/7197fb77b9a54008af69783495f7cf4b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,532 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/.tmp/f2/5f6a30c0549a4a2686de57e5c59f1fbc as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/5f6a30c0549a4a2686de57e5c59f1fbc 2023-02-07 19:03:26,533 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f1/408229011e5e4a66bc6b70be3447ff8c as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/408229011e5e4a66bc6b70be3447ff8c 2023-02-07 19:03:26,535 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/73d5aeae95c74d50aed4a7365ce0d63e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,536 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/.tmp/f2/81aeaab4bdb8464ebfda13ea07b3a7d0 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/81aeaab4bdb8464ebfda13ea07b3a7d0 2023-02-07 19:03:26,538 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/5f6a30c0549a4a2686de57e5c59f1fbc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,539 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0a1282db6180e4378a3c2c8042c3b000 in 96ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,539 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0a1282db6180e4378a3c2c8042c3b000: 2023-02-07 19:03:26,539 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:26,540 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/408229011e5e4a66bc6b70be3447ff8c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:26,541 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/81aeaab4bdb8464ebfda13ea07b3a7d0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,542 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/.tmp/f2/36575b7ca34a4aae8896a3f2d6ba1166 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/36575b7ca34a4aae8896a3f2d6ba1166 2023-02-07 19:03:26,542 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fa838629f0b995cf210d0cf657d72403 in 99ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,542 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fa838629f0b995cf210d0cf657d72403: 2023-02-07 19:03:26,542 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,546 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f2/1ab6d067b8ad4bd7887107f1cd914fe3 2023-02-07 19:03:26,547 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/36575b7ca34a4aae8896a3f2d6ba1166, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:26,547 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d40ee3354df51986b3e8ae536d1c3d7d in 105ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d40ee3354df51986b3e8ae536d1c3d7d: 2023-02-07 19:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. started... 2023-02-07 19:03:26,548 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c047b9d1f3594864142b8c14ceb7fcc0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 19:03:26,551 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:26,551 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. started... 2023-02-07 19:03:26,552 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 789c6678a6e90e3be1c5e0c9820bc03d: 2023-02-07 19:03:26,551 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:26,552 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 19:03:26,552 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. started... 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. started... 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 39b48234deadf1be3f1db960ae42cc4f: 2023-02-07 19:03:26,552 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:26,552 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bdf8583c738309b11b6482051ba12cac 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 19:03:26,552 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 19:03:26,561 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f2/8a56792ddfcf4f08bede87bb8deae3ea 2023-02-07 19:03:26,561 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f1/db0cc0d592b6490d8dbb3473eade5838 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/db0cc0d592b6490d8dbb3473eade5838 2023-02-07 19:03:26,571 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/db0cc0d592b6490d8dbb3473eade5838, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,571 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f2/753ad9b6c4e94e2db3bbd90b20b3d09d 2023-02-07 19:03:26,572 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/.tmp/f2/1ab6d067b8ad4bd7887107f1cd914fe3 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/1ab6d067b8ad4bd7887107f1cd914fe3 2023-02-07 19:03:26,573 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f1/9c28b3bfbb0d48a6ad5272ff199fdab3 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/9c28b3bfbb0d48a6ad5272ff199fdab3 2023-02-07 19:03:26,574 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f1/7cd692fdc22d41d1bc30c6075774f42f 2023-02-07 19:03:26,577 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f1/f93022244a564146aec027b8a6594538 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/f93022244a564146aec027b8a6594538 2023-02-07 19:03:26,585 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/1ab6d067b8ad4bd7887107f1cd914fe3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,586 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c26d5c15bc003874209d12daf85c0ecf in 142ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,586 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/f93022244a564146aec027b8a6594538, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,586 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c26d5c15bc003874209d12daf85c0ecf: 2023-02-07 19:03:26,586 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:26,586 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 19:03:26,587 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/.tmp/f2/753ad9b6c4e94e2db3bbd90b20b3d09d as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/753ad9b6c4e94e2db3bbd90b20b3d09d 2023-02-07 19:03:26,588 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/9c28b3bfbb0d48a6ad5272ff199fdab3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,589 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/.tmp/f2/8a56792ddfcf4f08bede87bb8deae3ea as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/8a56792ddfcf4f08bede87bb8deae3ea 2023-02-07 19:03:26,594 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f1/995f9874dfba4e879b5c9fc5ed0abf04 2023-02-07 19:03:26,595 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/8a56792ddfcf4f08bede87bb8deae3ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,595 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/753ad9b6c4e94e2db3bbd90b20b3d09d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,596 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for daf3207a7c51268a4e55f4c6725ccbb5 in 151ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,596 INFO [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9893dbb18eb205f10a4fe4ea091d7ba4 in 153ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,596 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for daf3207a7c51268a4e55f4c6725ccbb5: 2023-02-07 19:03:26,596 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9893dbb18eb205f10a4fe4ea091d7ba4: 2023-02-07 19:03:26,596 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:26,596 DEBUG [rs(jenkins-hbase6.apache.org,38215,1675796603132)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:26,596 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 19:03:26,596 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 19:03:26,596 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 19:03:26,596 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,597 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 19:03:26,597 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,38215,1675796603132' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 19:03:26,599 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,599 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:26,599 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,599 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:26,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,38215,1675796603132' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 19:03:26,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771e1f99[Count = 1] remaining members to acquire global barrier 2023-02-07 19:03:26,606 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f2/c4b48421328c4a0397cfb331c1cf0bd8 2023-02-07 19:03:26,611 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f1/7cd692fdc22d41d1bc30c6075774f42f as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/7cd692fdc22d41d1bc30c6075774f42f 2023-02-07 19:03:26,612 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f2/a888b44929564681921882115a0de1a0 2023-02-07 19:03:26,615 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/7cd692fdc22d41d1bc30c6075774f42f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:26,618 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/.tmp/f2/c4b48421328c4a0397cfb331c1cf0bd8 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/c4b48421328c4a0397cfb331c1cf0bd8 2023-02-07 19:03:26,619 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f1/995f9874dfba4e879b5c9fc5ed0abf04 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/995f9874dfba4e879b5c9fc5ed0abf04 2023-02-07 19:03:26,622 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/c4b48421328c4a0397cfb331c1cf0bd8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 19:03:26,623 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c047b9d1f3594864142b8c14ceb7fcc0 in 75ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,623 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c047b9d1f3594864142b8c14ceb7fcc0: 2023-02-07 19:03:26,623 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,623 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 19:03:26,624 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/995f9874dfba4e879b5c9fc5ed0abf04, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,625 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/.tmp/f2/a888b44929564681921882115a0de1a0 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/a888b44929564681921882115a0de1a0 2023-02-07 19:03:26,628 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/a888b44929564681921882115a0de1a0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 19:03:26,629 INFO [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bdf8583c738309b11b6482051ba12cac in 77ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:26,629 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bdf8583c738309b11b6482051ba12cac: 2023-02-07 19:03:26,629 DEBUG [rs(jenkins-hbase6.apache.org,39905,1675796603102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:26,629 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 19:03:26,629 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 19:03:26,629 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,630 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 19:03:26,630 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39905,1675796603102' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 19:03:26,631 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,631 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:26,632 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,632 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:26,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39905,1675796603102' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 19:03:26,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771e1f99[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:26,633 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 19:03:26,633 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,636 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 19:03:26,636 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 19:03:26,636 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 19:03:26,636 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 19:03:26,636 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,39905,1675796603102' in zk 2023-02-07 19:03:26,636 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,636 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,38215,1675796603132' in zk 2023-02-07 19:03:26,637 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,637 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:26,637 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,638 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 19:03:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:26,638 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:26,638 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 19:03:26,638 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,638 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:26,638 DEBUG [member: 'jenkins-hbase6.apache.org,39905,1675796603102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 19:03:26,638 DEBUG [member: 'jenkins-hbase6.apache.org,38215,1675796603132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 19:03:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,39905,1675796603102': 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39905,1675796603102' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,38215,1675796603132': 2023-02-07 19:03:26,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,38215,1675796603132' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:26,642 INFO [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-07 19:03:26,642 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:26,643 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:26,643 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,643 INFO [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:26,644 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,644 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,644 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:26,644 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:26,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,645 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:26,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,645 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,646 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,647 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:26,647 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:26,650 DEBUG [(jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:26,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-07 19:03:26,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:26,650 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:26,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:26,651 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:26,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:26,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:26,752 DEBUG [Listener at localhost/33873] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:26,752 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:26,752 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:26,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:26,757 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675796605179 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:26,758 DEBUG [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,758 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:26,758 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:26,758 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:26,758 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:26,758 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:26,758 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(239): region to add: 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=d40ee3354df51986b3e8ae536d1c3d7d as d40ee3354df51986b3e8ae536d1c3d7d in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=0a1282db6180e4378a3c2c8042c3b000 as 0a1282db6180e4378a3c2c8042c3b000 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=9893dbb18eb205f10a4fe4ea091d7ba4 as 9893dbb18eb205f10a4fe4ea091d7ba4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=daf3207a7c51268a4e55f4c6725ccbb5 as daf3207a7c51268a4e55f4c6725ccbb5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=c047b9d1f3594864142b8c14ceb7fcc0 as c047b9d1f3594864142b8c14ceb7fcc0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=c26d5c15bc003874209d12daf85c0ecf as c26d5c15bc003874209d12daf85c0ecf in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=fa838629f0b995cf210d0cf657d72403 as fa838629f0b995cf210d0cf657d72403 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,759 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=bdf8583c738309b11b6482051ba12cac as bdf8583c738309b11b6482051ba12cac in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,760 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=789c6678a6e90e3be1c5e0c9820bc03d as 789c6678a6e90e3be1c5e0c9820bc03d in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,760 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(585): clone region=39b48234deadf1be3f1db960ae42cc4f as 39b48234deadf1be3f1db960ae42cc4f in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,761 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => bdf8583c738309b11b6482051ba12cac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,761 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d40ee3354df51986b3e8ae536d1c3d7d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,761 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => fa838629f0b995cf210d0cf657d72403, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,762 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => daf3207a7c51268a4e55f4c6725ccbb5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,762 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0a1282db6180e4378a3c2c8042c3b000, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,762 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c047b9d1f3594864142b8c14ceb7fcc0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,762 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9893dbb18eb205f10a4fe4ea091d7ba4, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,763 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c26d5c15bc003874209d12daf85c0ecf, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,799 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,799 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a591b07279947beba6e02181634ad3b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,803 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,803 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 67a97b1cc1a04f44a1320fe12b940fc7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,804 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c99e6590ddf4fd18b21a0bb0015286c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,804 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,804 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 09aa70a095b44a18a2c71e051b771e6c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,805 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,805 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b407b73bb79c415c839eb6454269928d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,810 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6bd1673a03304984aab96dabb3bbbf55 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,811 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing bdf8583c738309b11b6482051ba12cac, disabling compactions & flushes 2023-02-07 19:03:26,811 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:26,811 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:26,811 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. after waiting 0 ms 2023-02-07 19:03:26,811 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:26,811 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:26,811 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for bdf8583c738309b11b6482051ba12cac: Waiting for close lock at 1675796606811Disabling compacts and flushes for region at 1675796606811Disabling writes for close at 1675796606811Writing region close event to WAL at 1675796606811Closed at 1675796606811 2023-02-07 19:03:26,812 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 789c6678a6e90e3be1c5e0c9820bc03d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,812 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eb6e6fad3ba249b08a6dc8d42604eae9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,813 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3a06c1b5571e44d8ac9fa07455507e07 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,813 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,814 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a48996a7ecc49369776d03f0c8d98fa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,814 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,814 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,814 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 027d2ab880134ee19f0ec9f5b5bcab03 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,815 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 955ace1484254f4bbba6795d61362ad9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,815 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,815 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1ea3242cbe204db9b49139df66976a43 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,816 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing daf3207a7c51268a4e55f4c6725ccbb5, disabling compactions & flushes 2023-02-07 19:03:26,816 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:26,816 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:26,816 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. after waiting 0 ms 2023-02-07 19:03:26,816 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:26,816 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:26,816 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for daf3207a7c51268a4e55f4c6725ccbb5: Waiting for close lock at 1675796606816Disabling compacts and flushes for region at 1675796606816Disabling writes for close at 1675796606816Writing region close event to WAL at 1675796606816Closed at 1675796606816 2023-02-07 19:03:26,817 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 39b48234deadf1be3f1db960ae42cc4f, NAME => 'testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,826 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 9893dbb18eb205f10a4fe4ea091d7ba4, disabling compactions & flushes 2023-02-07 19:03:26,826 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:26,826 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. after waiting 0 ms 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:26,827 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:26,827 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7317c96b53264643b2cac88cdf26ff7a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 9893dbb18eb205f10a4fe4ea091d7ba4: Waiting for close lock at 1675796606826Disabling compacts and flushes for region at 1675796606826Disabling writes for close at 1675796606827 (+1 ms)Writing region close event to WAL at 1675796606827Closed at 1675796606827 2023-02-07 19:03:26,827 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98340c184e2d4fd89ec8a7b6b0e63626 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c047b9d1f3594864142b8c14ceb7fcc0, disabling compactions & flushes 2023-02-07 19:03:26,827 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. after waiting 0 ms 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,827 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:26,827 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c047b9d1f3594864142b8c14ceb7fcc0: Waiting for close lock at 1675796606827Disabling compacts and flushes for region at 1675796606827Disabling writes for close at 1675796606827Writing region close event to WAL at 1675796606827Closed at 1675796606827 2023-02-07 19:03:26,829 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9056136757944035927de1c8323bbfda from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,829 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 57176193ea084ba3838f90b2819443a4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0a1282db6180e4378a3c2c8042c3b000, disabling compactions & flushes 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d40ee3354df51986b3e8ae536d1c3d7d, disabling compactions & flushes 2023-02-07 19:03:26,836 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. after waiting 0 ms 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:26,836 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0a1282db6180e4378a3c2c8042c3b000: Waiting for close lock at 1675796606836Disabling compacts and flushes for region at 1675796606836Disabling writes for close at 1675796606836Writing region close event to WAL at 1675796606836Closed at 1675796606836 2023-02-07 19:03:26,836 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. after waiting 0 ms 2023-02-07 19:03:26,836 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:26,837 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d40ee3354df51986b3e8ae536d1c3d7d: Waiting for close lock at 1675796606836Disabling compacts and flushes for region at 1675796606836Disabling writes for close at 1675796606836Writing region close event to WAL at 1675796606837 (+1 ms)Closed at 1675796606837 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing fa838629f0b995cf210d0cf657d72403, disabling compactions & flushes 2023-02-07 19:03:26,837 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. after waiting 0 ms 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,837 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for fa838629f0b995cf210d0cf657d72403: Waiting for close lock at 1675796606837Disabling compacts and flushes for region at 1675796606837Disabling writes for close at 1675796606837Writing region close event to WAL at 1675796606837Closed at 1675796606837 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c26d5c15bc003874209d12daf85c0ecf, disabling compactions & flushes 2023-02-07 19:03:26,837 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. after waiting 0 ms 2023-02-07 19:03:26,837 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:26,837 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:26,838 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c26d5c15bc003874209d12daf85c0ecf: Waiting for close lock at 1675796606837Disabling compacts and flushes for region at 1675796606837Disabling writes for close at 1675796606837Writing region close event to WAL at 1675796606837Closed at 1675796606837 2023-02-07 19:03:26,839 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,839 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 789c6678a6e90e3be1c5e0c9820bc03d, disabling compactions & flushes 2023-02-07 19:03:26,839 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:26,839 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:26,839 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. after waiting 0 ms 2023-02-07 19:03:26,839 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:26,839 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:26,839 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 789c6678a6e90e3be1c5e0c9820bc03d: Waiting for close lock at 1675796606839Disabling compacts and flushes for region at 1675796606839Disabling writes for close at 1675796606839Writing region close event to WAL at 1675796606839Closed at 1675796606839 2023-02-07 19:03:26,840 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:26,840 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 39b48234deadf1be3f1db960ae42cc4f, disabling compactions & flushes 2023-02-07 19:03:26,840 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:26,840 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:26,840 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. after waiting 0 ms 2023-02-07 19:03:26,840 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:26,840 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:26,840 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 39b48234deadf1be3f1db960ae42cc4f: Waiting for close lock at 1675796606840Disabling compacts and flushes for region at 1675796606840Disabling writes for close at 1675796606840Writing region close event to WAL at 1675796606840Closed at 1675796606840 2023-02-07 19:03:26,840 INFO [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675796605179 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:26,841 DEBUG [Listener at localhost/33873] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,841 DEBUG [Listener at localhost/33873] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c 2023-02-07 19:03:26,841 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:26,842 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:26,842 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-07 19:03:26,843 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------0a1282db6180e4378a3c2c8042c3b000/ 2023-02-07 19:03:26,843 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,843 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,843 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0a1282db6180e4378a3c2c8042c3b000-955ace1484254f4bbba6795d61362ad9 2023-02-07 19:03:26,843 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,843 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0a1282db6180e4378a3c2c8042c3b000-7317c96b53264643b2cac88cdf26ff7a 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------39b48234deadf1be3f1db960ae42cc4f/ 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------789c6678a6e90e3be1c5e0c9820bc03d/ 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------9893dbb18eb205f10a4fe4ea091d7ba4/ 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,844 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9893dbb18eb205f10a4fe4ea091d7ba4-b407b73bb79c415c839eb6454269928d 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9893dbb18eb205f10a4fe4ea091d7ba4-eb6e6fad3ba249b08a6dc8d42604eae9 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------bdf8583c738309b11b6482051ba12cac/ 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,845 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bdf8583c738309b11b6482051ba12cac-9a591b07279947beba6e02181634ad3b 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bdf8583c738309b11b6482051ba12cac-9c99e6590ddf4fd18b21a0bb0015286c 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------c047b9d1f3594864142b8c14ceb7fcc0/ 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c047b9d1f3594864142b8c14ceb7fcc0-09aa70a095b44a18a2c71e051b771e6c 2023-02-07 19:03:26,846 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c047b9d1f3594864142b8c14ceb7fcc0-3a06c1b5571e44d8ac9fa07455507e07 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------c26d5c15bc003874209d12daf85c0ecf/ 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c26d5c15bc003874209d12daf85c0ecf-1ea3242cbe204db9b49139df66976a43 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,847 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c26d5c15bc003874209d12daf85c0ecf-9056136757944035927de1c8323bbfda 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------d40ee3354df51986b3e8ae536d1c3d7d/ 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d40ee3354df51986b3e8ae536d1c3d7d-027d2ab880134ee19f0ec9f5b5bcab03 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d40ee3354df51986b3e8ae536d1c3d7d-98340c184e2d4fd89ec8a7b6b0e63626 2023-02-07 19:03:26,848 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------daf3207a7c51268a4e55f4c6725ccbb5/ 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=daf3207a7c51268a4e55f4c6725ccbb5-67a97b1cc1a04f44a1320fe12b940fc7 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=daf3207a7c51268a4e55f4c6725ccbb5-6bd1673a03304984aab96dabb3bbbf55 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |----------fa838629f0b995cf210d0cf657d72403/ 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:26,849 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:26,850 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fa838629f0b995cf210d0cf657d72403-2a48996a7ecc49369776d03f0c8d98fa 2023-02-07 19:03:26,850 DEBUG [Listener at localhost/33873] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:26,850 DEBUG [Listener at localhost/33873] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fa838629f0b995cf210d0cf657d72403-57176193ea084ba3838f90b2819443a4 2023-02-07 19:03:26,853 INFO [Listener at localhost/33873] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 19:03:27,378 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,378 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,380 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,382 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:27,383 DEBUG [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f1 2023-02-07 19:03:27,384 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39b48234deadf1be3f1db960ae42cc4f columnFamilyName f1 2023-02-07 19:03:27,384 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(310): Store=39b48234deadf1be3f1db960ae42cc4f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,384 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:27,385 DEBUG [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f2 2023-02-07 19:03:27,385 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39b48234deadf1be3f1db960ae42cc4f columnFamilyName f2 2023-02-07 19:03:27,386 INFO [StoreOpener-39b48234deadf1be3f1db960ae42cc4f-1] regionserver.HStore(310): Store=39b48234deadf1be3f1db960ae42cc4f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,386 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,386 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened 39b48234deadf1be3f1db960ae42cc4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69923480, jitterRate=0.041941046714782715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,386 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for 39b48234deadf1be3f1db960ae42cc4f: Writing region info on filesystem at 1675796607380Initializing all the Stores at 1675796607381 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607381Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607381Region opened successfully at 1675796607386 (+5 ms) 2023-02-07 19:03:27,386 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing 39b48234deadf1be3f1db960ae42cc4f, disabling compactions & flushes 2023-02-07 19:03:27,386 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,387 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,387 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. after waiting 0 ms 2023-02-07 19:03:27,387 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,387 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,387 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for 39b48234deadf1be3f1db960ae42cc4f: Waiting for close lock at 1675796607386Disabling compacts and flushes for region at 1675796607386Disabling writes for close at 1675796607387 (+1 ms)Writing region close event to WAL at 1675796607387Closed at 1675796607387 2023-02-07 19:03:27,387 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,387 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,388 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,390 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:27,391 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1 2023-02-07 19:03:27,391 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c047b9d1f3594864142b8c14ceb7fcc0 columnFamilyName f1 2023-02-07 19:03:27,395 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/testWithMockedMapReduceMultiRegion=c047b9d1f3594864142b8c14ceb7fcc0-09aa70a095b44a18a2c71e051b771e6c 2023-02-07 19:03:27,395 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(310): Store=c047b9d1f3594864142b8c14ceb7fcc0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,395 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:27,396 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2 2023-02-07 19:03:27,396 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c047b9d1f3594864142b8c14ceb7fcc0 columnFamilyName f2 2023-02-07 19:03:27,400 DEBUG [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/testWithMockedMapReduceMultiRegion=c047b9d1f3594864142b8c14ceb7fcc0-3a06c1b5571e44d8ac9fa07455507e07 2023-02-07 19:03:27,400 INFO [StoreOpener-c047b9d1f3594864142b8c14ceb7fcc0-1] regionserver.HStore(310): Store=c047b9d1f3594864142b8c14ceb7fcc0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,400 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,400 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened c047b9d1f3594864142b8c14ceb7fcc0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62265605, jitterRate=-0.0721701830625534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,400 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for c047b9d1f3594864142b8c14ceb7fcc0: Writing region info on filesystem at 1675796607389Initializing all the Stores at 1675796607389Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607389Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607389Region opened successfully at 1675796607400 (+11 ms) 2023-02-07 19:03:27,416 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing c047b9d1f3594864142b8c14ceb7fcc0, disabling compactions & flushes 2023-02-07 19:03:27,416 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,416 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,416 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. after waiting 0 ms 2023-02-07 19:03:27,416 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,419 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,419 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for c047b9d1f3594864142b8c14ceb7fcc0: Waiting for close lock at 1675796607416Disabling compacts and flushes for region at 1675796607416Disabling writes for close at 1675796607416Writing region close event to WAL at 1675796607419 (+3 ms)Closed at 1675796607419 2023-02-07 19:03:27,419 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,420 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,421 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,423 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:27,424 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1 2023-02-07 19:03:27,424 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdf8583c738309b11b6482051ba12cac columnFamilyName f1 2023-02-07 19:03:27,428 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/testWithMockedMapReduceMultiRegion=bdf8583c738309b11b6482051ba12cac-9a591b07279947beba6e02181634ad3b 2023-02-07 19:03:27,428 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(310): Store=bdf8583c738309b11b6482051ba12cac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,428 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:27,429 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2 2023-02-07 19:03:27,429 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdf8583c738309b11b6482051ba12cac columnFamilyName f2 2023-02-07 19:03:27,437 DEBUG [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/testWithMockedMapReduceMultiRegion=bdf8583c738309b11b6482051ba12cac-9c99e6590ddf4fd18b21a0bb0015286c 2023-02-07 19:03:27,437 INFO [StoreOpener-bdf8583c738309b11b6482051ba12cac-1] regionserver.HStore(310): Store=bdf8583c738309b11b6482051ba12cac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,437 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,437 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened bdf8583c738309b11b6482051ba12cac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66476655, jitterRate=-0.009420648217201233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,437 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for bdf8583c738309b11b6482051ba12cac: Writing region info on filesystem at 1675796607421Initializing all the Stores at 1675796607422 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607422Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607422Region opened successfully at 1675796607437 (+15 ms) 2023-02-07 19:03:27,449 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing bdf8583c738309b11b6482051ba12cac, disabling compactions & flushes 2023-02-07 19:03:27,449 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,449 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,449 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. after waiting 0 ms 2023-02-07 19:03:27,449 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,450 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,450 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for bdf8583c738309b11b6482051ba12cac: Waiting for close lock at 1675796607449Disabling compacts and flushes for region at 1675796607449Disabling writes for close at 1675796607449Writing region close event to WAL at 1675796607450 (+1 ms)Closed at 1675796607450 2023-02-07 19:03:27,451 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,451 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,452 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,454 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:27,456 DEBUG [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f1 2023-02-07 19:03:27,456 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 789c6678a6e90e3be1c5e0c9820bc03d columnFamilyName f1 2023-02-07 19:03:27,457 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(310): Store=789c6678a6e90e3be1c5e0c9820bc03d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,457 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:27,458 DEBUG [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f2 2023-02-07 19:03:27,458 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 789c6678a6e90e3be1c5e0c9820bc03d columnFamilyName f2 2023-02-07 19:03:27,459 INFO [StoreOpener-789c6678a6e90e3be1c5e0c9820bc03d-1] regionserver.HStore(310): Store=789c6678a6e90e3be1c5e0c9820bc03d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,459 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,459 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened 789c6678a6e90e3be1c5e0c9820bc03d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71954578, jitterRate=0.0722067654132843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,459 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for 789c6678a6e90e3be1c5e0c9820bc03d: Writing region info on filesystem at 1675796607452Initializing all the Stores at 1675796607453 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607453Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607453Region opened successfully at 1675796607459 (+6 ms) 2023-02-07 19:03:27,459 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing 789c6678a6e90e3be1c5e0c9820bc03d, disabling compactions & flushes 2023-02-07 19:03:27,459 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,459 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,459 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. after waiting 0 ms 2023-02-07 19:03:27,459 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,460 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,460 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for 789c6678a6e90e3be1c5e0c9820bc03d: Waiting for close lock at 1675796607459Disabling compacts and flushes for region at 1675796607459Disabling writes for close at 1675796607459Writing region close event to WAL at 1675796607460 (+1 ms)Closed at 1675796607460 2023-02-07 19:03:27,460 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,461 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,462 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,464 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:27,465 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1 2023-02-07 19:03:27,465 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c26d5c15bc003874209d12daf85c0ecf columnFamilyName f1 2023-02-07 19:03:27,470 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/testWithMockedMapReduceMultiRegion=c26d5c15bc003874209d12daf85c0ecf-1ea3242cbe204db9b49139df66976a43 2023-02-07 19:03:27,470 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(310): Store=c26d5c15bc003874209d12daf85c0ecf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,470 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:27,471 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2 2023-02-07 19:03:27,471 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c26d5c15bc003874209d12daf85c0ecf columnFamilyName f2 2023-02-07 19:03:27,475 DEBUG [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/testWithMockedMapReduceMultiRegion=c26d5c15bc003874209d12daf85c0ecf-9056136757944035927de1c8323bbfda 2023-02-07 19:03:27,475 INFO [StoreOpener-c26d5c15bc003874209d12daf85c0ecf-1] regionserver.HStore(310): Store=c26d5c15bc003874209d12daf85c0ecf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,475 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,475 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened c26d5c15bc003874209d12daf85c0ecf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74875448, jitterRate=0.1157311201095581}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,475 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for c26d5c15bc003874209d12daf85c0ecf: Writing region info on filesystem at 1675796607463Initializing all the Stores at 1675796607463Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607463Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607463Region opened successfully at 1675796607475 (+12 ms) 2023-02-07 19:03:27,486 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing c26d5c15bc003874209d12daf85c0ecf, disabling compactions & flushes 2023-02-07 19:03:27,487 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,487 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,487 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. after waiting 0 ms 2023-02-07 19:03:27,488 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,488 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,488 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for c26d5c15bc003874209d12daf85c0ecf: Waiting for close lock at 1675796607486Disabling compacts and flushes for region at 1675796607486Disabling writes for close at 1675796607488 (+2 ms)Writing region close event to WAL at 1675796607488Closed at 1675796607488 2023-02-07 19:03:27,489 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,489 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,490 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,492 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:27,493 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1 2023-02-07 19:03:27,493 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a1282db6180e4378a3c2c8042c3b000 columnFamilyName f1 2023-02-07 19:03:27,497 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/testWithMockedMapReduceMultiRegion=0a1282db6180e4378a3c2c8042c3b000-955ace1484254f4bbba6795d61362ad9 2023-02-07 19:03:27,497 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(310): Store=0a1282db6180e4378a3c2c8042c3b000/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,497 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:27,498 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2 2023-02-07 19:03:27,498 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a1282db6180e4378a3c2c8042c3b000 columnFamilyName f2 2023-02-07 19:03:27,502 DEBUG [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/testWithMockedMapReduceMultiRegion=0a1282db6180e4378a3c2c8042c3b000-7317c96b53264643b2cac88cdf26ff7a 2023-02-07 19:03:27,502 INFO [StoreOpener-0a1282db6180e4378a3c2c8042c3b000-1] regionserver.HStore(310): Store=0a1282db6180e4378a3c2c8042c3b000/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,502 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,503 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened 0a1282db6180e4378a3c2c8042c3b000; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71009606, jitterRate=0.058125585317611694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,503 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for 0a1282db6180e4378a3c2c8042c3b000: Writing region info on filesystem at 1675796607490Initializing all the Stores at 1675796607491 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607491Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607491Region opened successfully at 1675796607503 (+12 ms) 2023-02-07 19:03:27,511 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing 0a1282db6180e4378a3c2c8042c3b000, disabling compactions & flushes 2023-02-07 19:03:27,511 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,511 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,511 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. after waiting 0 ms 2023-02-07 19:03:27,511 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,512 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,512 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for 0a1282db6180e4378a3c2c8042c3b000: Waiting for close lock at 1675796607511Disabling compacts and flushes for region at 1675796607511Disabling writes for close at 1675796607511Writing region close event to WAL at 1675796607511Closed at 1675796607511 2023-02-07 19:03:27,512 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,512 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,513 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,515 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:27,516 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1 2023-02-07 19:03:27,516 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daf3207a7c51268a4e55f4c6725ccbb5 columnFamilyName f1 2023-02-07 19:03:27,520 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/testWithMockedMapReduceMultiRegion=daf3207a7c51268a4e55f4c6725ccbb5-67a97b1cc1a04f44a1320fe12b940fc7 2023-02-07 19:03:27,520 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(310): Store=daf3207a7c51268a4e55f4c6725ccbb5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,520 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:27,521 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2 2023-02-07 19:03:27,521 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daf3207a7c51268a4e55f4c6725ccbb5 columnFamilyName f2 2023-02-07 19:03:27,526 DEBUG [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/testWithMockedMapReduceMultiRegion=daf3207a7c51268a4e55f4c6725ccbb5-6bd1673a03304984aab96dabb3bbbf55 2023-02-07 19:03:27,526 INFO [StoreOpener-daf3207a7c51268a4e55f4c6725ccbb5-1] regionserver.HStore(310): Store=daf3207a7c51268a4e55f4c6725ccbb5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,526 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,526 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened daf3207a7c51268a4e55f4c6725ccbb5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74479442, jitterRate=0.10983017086982727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,527 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for daf3207a7c51268a4e55f4c6725ccbb5: Writing region info on filesystem at 1675796607513Initializing all the Stores at 1675796607514 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607514Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607514Region opened successfully at 1675796607527 (+13 ms) 2023-02-07 19:03:27,539 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing daf3207a7c51268a4e55f4c6725ccbb5, disabling compactions & flushes 2023-02-07 19:03:27,540 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,540 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,540 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. after waiting 0 ms 2023-02-07 19:03:27,540 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,543 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,543 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for daf3207a7c51268a4e55f4c6725ccbb5: Waiting for close lock at 1675796607539Disabling compacts and flushes for region at 1675796607539Disabling writes for close at 1675796607540 (+1 ms)Writing region close event to WAL at 1675796607543 (+3 ms)Closed at 1675796607543 2023-02-07 19:03:27,543 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,543 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,548 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,551 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:27,552 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1 2023-02-07 19:03:27,552 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa838629f0b995cf210d0cf657d72403 columnFamilyName f1 2023-02-07 19:03:27,557 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/testWithMockedMapReduceMultiRegion=fa838629f0b995cf210d0cf657d72403-2a48996a7ecc49369776d03f0c8d98fa 2023-02-07 19:03:27,557 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(310): Store=fa838629f0b995cf210d0cf657d72403/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,557 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:27,557 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2 2023-02-07 19:03:27,558 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa838629f0b995cf210d0cf657d72403 columnFamilyName f2 2023-02-07 19:03:27,561 DEBUG [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/testWithMockedMapReduceMultiRegion=fa838629f0b995cf210d0cf657d72403-57176193ea084ba3838f90b2819443a4 2023-02-07 19:03:27,561 INFO [StoreOpener-fa838629f0b995cf210d0cf657d72403-1] regionserver.HStore(310): Store=fa838629f0b995cf210d0cf657d72403/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,561 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,561 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened fa838629f0b995cf210d0cf657d72403; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72977773, jitterRate=0.08745355904102325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,561 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for fa838629f0b995cf210d0cf657d72403: Writing region info on filesystem at 1675796607548Initializing all the Stores at 1675796607549 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607549Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607550 (+1 ms)Region opened successfully at 1675796607561 (+11 ms) 2023-02-07 19:03:27,569 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing fa838629f0b995cf210d0cf657d72403, disabling compactions & flushes 2023-02-07 19:03:27,570 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,570 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,570 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. after waiting 0 ms 2023-02-07 19:03:27,570 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,570 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,570 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for fa838629f0b995cf210d0cf657d72403: Waiting for close lock at 1675796607569Disabling compacts and flushes for region at 1675796607569Disabling writes for close at 1675796607570 (+1 ms)Writing region close event to WAL at 1675796607570Closed at 1675796607570 2023-02-07 19:03:27,571 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,571 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,572 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,574 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:27,575 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1 2023-02-07 19:03:27,575 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d40ee3354df51986b3e8ae536d1c3d7d columnFamilyName f1 2023-02-07 19:03:27,579 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/testWithMockedMapReduceMultiRegion=d40ee3354df51986b3e8ae536d1c3d7d-027d2ab880134ee19f0ec9f5b5bcab03 2023-02-07 19:03:27,579 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(310): Store=d40ee3354df51986b3e8ae536d1c3d7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,579 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:27,580 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2 2023-02-07 19:03:27,580 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d40ee3354df51986b3e8ae536d1c3d7d columnFamilyName f2 2023-02-07 19:03:27,583 DEBUG [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/testWithMockedMapReduceMultiRegion=d40ee3354df51986b3e8ae536d1c3d7d-98340c184e2d4fd89ec8a7b6b0e63626 2023-02-07 19:03:27,583 INFO [StoreOpener-d40ee3354df51986b3e8ae536d1c3d7d-1] regionserver.HStore(310): Store=d40ee3354df51986b3e8ae536d1c3d7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,583 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,583 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened d40ee3354df51986b3e8ae536d1c3d7d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69538499, jitterRate=0.03620438277721405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,583 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for d40ee3354df51986b3e8ae536d1c3d7d: Writing region info on filesystem at 1675796607572Initializing all the Stores at 1675796607573 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607573Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607573Region opened successfully at 1675796607583 (+10 ms) 2023-02-07 19:03:27,593 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing d40ee3354df51986b3e8ae536d1c3d7d, disabling compactions & flushes 2023-02-07 19:03:27,593 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,593 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,593 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. after waiting 0 ms 2023-02-07 19:03:27,593 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,594 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,594 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for d40ee3354df51986b3e8ae536d1c3d7d: Waiting for close lock at 1675796607593Disabling compacts and flushes for region at 1675796607593Disabling writes for close at 1675796607593Writing region close event to WAL at 1675796607594 (+1 ms)Closed at 1675796607594 2023-02-07 19:03:27,594 DEBUG [Listener at localhost/33873] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:27,595 INFO [Listener at localhost/33873] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:27,596 DEBUG [Listener at localhost/33873] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:27,597 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:27,598 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1 2023-02-07 19:03:27,598 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9893dbb18eb205f10a4fe4ea091d7ba4 columnFamilyName f1 2023-02-07 19:03:27,602 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/testWithMockedMapReduceMultiRegion=9893dbb18eb205f10a4fe4ea091d7ba4-b407b73bb79c415c839eb6454269928d 2023-02-07 19:03:27,602 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(310): Store=9893dbb18eb205f10a4fe4ea091d7ba4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,602 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:27,602 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2 2023-02-07 19:03:27,603 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9893dbb18eb205f10a4fe4ea091d7ba4 columnFamilyName f2 2023-02-07 19:03:27,606 DEBUG [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(539): loaded hdfs://localhost:44889/user/jenkins/test-data/b2eae3dc-cc57-b2ad-07b3-ac2830a4480d/testWithMockedMapReduceMultiRegion/0655d734-f05f-4dc2-b021-306b8b96531c/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/testWithMockedMapReduceMultiRegion=9893dbb18eb205f10a4fe4ea091d7ba4-eb6e6fad3ba249b08a6dc8d42604eae9 2023-02-07 19:03:27,606 INFO [StoreOpener-9893dbb18eb205f10a4fe4ea091d7ba4-1] regionserver.HStore(310): Store=9893dbb18eb205f10a4fe4ea091d7ba4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:27,606 DEBUG [Listener at localhost/33873] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:27,606 INFO [Listener at localhost/33873] regionserver.HRegion(1071): Opened 9893dbb18eb205f10a4fe4ea091d7ba4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69028838, jitterRate=0.02860984206199646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:27,606 DEBUG [Listener at localhost/33873] regionserver.HRegion(964): Region open journal for 9893dbb18eb205f10a4fe4ea091d7ba4: Writing region info on filesystem at 1675796607596Initializing all the Stores at 1675796607596Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607596Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796607596Region opened successfully at 1675796607606 (+10 ms) 2023-02-07 19:03:27,615 DEBUG [Listener at localhost/33873] regionserver.HRegion(1603): Closing 9893dbb18eb205f10a4fe4ea091d7ba4, disabling compactions & flushes 2023-02-07 19:03:27,615 INFO [Listener at localhost/33873] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,615 DEBUG [Listener at localhost/33873] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,615 DEBUG [Listener at localhost/33873] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. after waiting 0 ms 2023-02-07 19:03:27,615 DEBUG [Listener at localhost/33873] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,655 INFO [Listener at localhost/33873] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,655 DEBUG [Listener at localhost/33873] regionserver.HRegion(1557): Region close journal for 9893dbb18eb205f10a4fe4ea091d7ba4: Waiting for close lock at 1675796607615Disabling compacts and flushes for region at 1675796607615Disabling writes for close at 1675796607615Writing region close event to WAL at 1675796607655 (+40 ms)Closed at 1675796607655 2023-02-07 19:03:27,660 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,660 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,661 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-07 19:03:27,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,664 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,664 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,665 INFO [Listener at localhost/33873] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,668 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,668 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,669 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796607669"}]},"ts":"1675796607669"} 2023-02-07 19:03:27,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:27,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-07 19:03:27,673 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-07 19:03:27,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, UNASSIGN}] 2023-02-07 19:03:27,675 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, UNASSIGN 2023-02-07 19:03:27,675 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, UNASSIGN 2023-02-07 19:03:27,675 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, UNASSIGN 2023-02-07 19:03:27,675 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, UNASSIGN 2023-02-07 19:03:27,676 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, UNASSIGN 2023-02-07 19:03:27,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=bdf8583c738309b11b6482051ba12cac, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:27,676 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607676"}]},"ts":"1675796607676"} 2023-02-07 19:03:27,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=39b48234deadf1be3f1db960ae42cc4f, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:27,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796607676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607676"}]},"ts":"1675796607676"} 2023-02-07 19:03:27,676 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fa838629f0b995cf210d0cf657d72403, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:27,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=789c6678a6e90e3be1c5e0c9820bc03d, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:27,676 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607676"}]},"ts":"1675796607676"} 2023-02-07 19:03:27,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=c047b9d1f3594864142b8c14ceb7fcc0, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:27,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796607676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607676"}]},"ts":"1675796607676"} 2023-02-07 19:03:27,677 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607676"}]},"ts":"1675796607676"} 2023-02-07 19:03:27,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure bdf8583c738309b11b6482051ba12cac, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:27,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 39b48234deadf1be3f1db960ae42cc4f, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:27,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure fa838629f0b995cf210d0cf657d72403, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:27,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 789c6678a6e90e3be1c5e0c9820bc03d, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:27,680 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, UNASSIGN 2023-02-07 19:03:27,680 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=35, state=RUNNABLE; CloseRegionProcedure c047b9d1f3594864142b8c14ceb7fcc0, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:27,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d40ee3354df51986b3e8ae536d1c3d7d, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:27,681 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607681"}]},"ts":"1675796607681"} 2023-02-07 19:03:27,681 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, UNASSIGN 2023-02-07 19:03:27,682 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9893dbb18eb205f10a4fe4ea091d7ba4, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:27,682 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607682"}]},"ts":"1675796607682"} 2023-02-07 19:03:27,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, UNASSIGN 2023-02-07 19:03:27,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure d40ee3354df51986b3e8ae536d1c3d7d, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:27,683 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, UNASSIGN 2023-02-07 19:03:27,683 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=daf3207a7c51268a4e55f4c6725ccbb5, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:27,683 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607683"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607683"}]},"ts":"1675796607683"} 2023-02-07 19:03:27,683 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, UNASSIGN 2023-02-07 19:03:27,684 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=0a1282db6180e4378a3c2c8042c3b000, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:27,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 9893dbb18eb205f10a4fe4ea091d7ba4, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:27,684 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607684"}]},"ts":"1675796607684"} 2023-02-07 19:03:27,685 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c26d5c15bc003874209d12daf85c0ecf, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:27,685 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607685"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796607685"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796607685"}]},"ts":"1675796607685"} 2023-02-07 19:03:27,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure daf3207a7c51268a4e55f4c6725ccbb5, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:27,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 0a1282db6180e4378a3c2c8042c3b000, server=jenkins-hbase6.apache.org,39905,1675796603102}] 2023-02-07 19:03:27,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure c26d5c15bc003874209d12daf85c0ecf, server=jenkins-hbase6.apache.org,38215,1675796603132}] 2023-02-07 19:03:27,769 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,769 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:27,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:27,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing c047b9d1f3594864142b8c14ceb7fcc0, disabling compactions & flushes 2023-02-07 19:03:27,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. after waiting 0 ms 2023-02-07 19:03:27,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:27,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 39b48234deadf1be3f1db960ae42cc4f, disabling compactions & flushes 2023-02-07 19:03:27,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. after waiting 0 ms 2023-02-07 19:03:27,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 19:03:27,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0. 2023-02-07 19:03:27,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for c047b9d1f3594864142b8c14ceb7fcc0: Waiting for close lock at 1675796607830Running coprocessor pre-close hooks at 1675796607830Disabling compacts and flushes for region at 1675796607830Disabling writes for close at 1675796607830Writing region close event to WAL at 1675796607831 (+1 ms)Running coprocessor post-close hooks at 1675796607835 (+4 ms)Closed at 1675796607835 2023-02-07 19:03:27,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f. 2023-02-07 19:03:27,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 39b48234deadf1be3f1db960ae42cc4f: Waiting for close lock at 1675796607831Running coprocessor pre-close hooks at 1675796607831Disabling compacts and flushes for region at 1675796607831Disabling writes for close at 1675796607831Writing region close event to WAL at 1675796607831Running coprocessor post-close hooks at 1675796607835 (+4 ms)Closed at 1675796607835 2023-02-07 19:03:27,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:27,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:27,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing d40ee3354df51986b3e8ae536d1c3d7d, disabling compactions & flushes 2023-02-07 19:03:27,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. after waiting 0 ms 2023-02-07 19:03:27,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,836 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=c047b9d1f3594864142b8c14ceb7fcc0, regionState=CLOSED 2023-02-07 19:03:27,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607836"}]},"ts":"1675796607836"} 2023-02-07 19:03:27,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:27,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:27,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 789c6678a6e90e3be1c5e0c9820bc03d, disabling compactions & flushes 2023-02-07 19:03:27,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. after waiting 0 ms 2023-02-07 19:03:27,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,837 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=39b48234deadf1be3f1db960ae42cc4f, regionState=CLOSED 2023-02-07 19:03:27,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796607837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607837"}]},"ts":"1675796607837"} 2023-02-07 19:03:27,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=35 2023-02-07 19:03:27,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=35, state=SUCCESS; CloseRegionProcedure c047b9d1f3594864142b8c14ceb7fcc0, server=jenkins-hbase6.apache.org,39905,1675796603102 in 158 msec 2023-02-07 19:03:27,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-07 19:03:27,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 39b48234deadf1be3f1db960ae42cc4f, server=jenkins-hbase6.apache.org,38215,1675796603132 in 161 msec 2023-02-07 19:03:27,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c047b9d1f3594864142b8c14ceb7fcc0, UNASSIGN in 167 msec 2023-02-07 19:03:27,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d. 2023-02-07 19:03:27,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for d40ee3354df51986b3e8ae536d1c3d7d: Waiting for close lock at 1675796607836Running coprocessor pre-close hooks at 1675796607836Disabling compacts and flushes for region at 1675796607836Disabling writes for close at 1675796607836Writing region close event to WAL at 1675796607838 (+2 ms)Running coprocessor post-close hooks at 1675796607842 (+4 ms)Closed at 1675796607842 2023-02-07 19:03:27,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:27,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:27,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 19:03:27,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=39b48234deadf1be3f1db960ae42cc4f, UNASSIGN in 168 msec 2023-02-07 19:03:27,846 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d40ee3354df51986b3e8ae536d1c3d7d, regionState=CLOSED 2023-02-07 19:03:27,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing daf3207a7c51268a4e55f4c6725ccbb5, disabling compactions & flushes 2023-02-07 19:03:27,846 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607846"}]},"ts":"1675796607846"} 2023-02-07 19:03:27,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. after waiting 0 ms 2023-02-07 19:03:27,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d. 2023-02-07 19:03:27,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 789c6678a6e90e3be1c5e0c9820bc03d: Waiting for close lock at 1675796607837Running coprocessor pre-close hooks at 1675796607837Disabling compacts and flushes for region at 1675796607837Disabling writes for close at 1675796607837Writing region close event to WAL at 1675796607838 (+1 ms)Running coprocessor post-close hooks at 1675796607847 (+9 ms)Closed at 1675796607847 2023-02-07 19:03:27,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:27,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:27,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing c26d5c15bc003874209d12daf85c0ecf, disabling compactions & flushes 2023-02-07 19:03:27,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. after waiting 0 ms 2023-02-07 19:03:27,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,849 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=789c6678a6e90e3be1c5e0c9820bc03d, regionState=CLOSED 2023-02-07 19:03:27,849 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675796607848"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607848"}]},"ts":"1675796607848"} 2023-02-07 19:03:27,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-07 19:03:27,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure d40ee3354df51986b3e8ae536d1c3d7d, server=jenkins-hbase6.apache.org,39905,1675796603102 in 165 msec 2023-02-07 19:03:27,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5. 2023-02-07 19:03:27,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for daf3207a7c51268a4e55f4c6725ccbb5: Waiting for close lock at 1675796607846Running coprocessor pre-close hooks at 1675796607846Disabling compacts and flushes for region at 1675796607846Disabling writes for close at 1675796607846Writing region close event to WAL at 1675796607847 (+1 ms)Running coprocessor post-close hooks at 1675796607851 (+4 ms)Closed at 1675796607851 2023-02-07 19:03:27,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d40ee3354df51986b3e8ae536d1c3d7d, UNASSIGN in 177 msec 2023-02-07 19:03:27,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-07 19:03:27,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 789c6678a6e90e3be1c5e0c9820bc03d, server=jenkins-hbase6.apache.org,38215,1675796603132 in 170 msec 2023-02-07 19:03:27,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:27,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:27,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 0a1282db6180e4378a3c2c8042c3b000, disabling compactions & flushes 2023-02-07 19:03:27,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. after waiting 0 ms 2023-02-07 19:03:27,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf. 2023-02-07 19:03:27,853 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=daf3207a7c51268a4e55f4c6725ccbb5, regionState=CLOSED 2023-02-07 19:03:27,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for c26d5c15bc003874209d12daf85c0ecf: Waiting for close lock at 1675796607848Running coprocessor pre-close hooks at 1675796607848Disabling compacts and flushes for region at 1675796607848Disabling writes for close at 1675796607848Writing region close event to WAL at 1675796607849 (+1 ms)Running coprocessor post-close hooks at 1675796607853 (+4 ms)Closed at 1675796607853 2023-02-07 19:03:27,853 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607853"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607853"}]},"ts":"1675796607853"} 2023-02-07 19:03:27,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=789c6678a6e90e3be1c5e0c9820bc03d, UNASSIGN in 179 msec 2023-02-07 19:03:27,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:27,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:27,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 9893dbb18eb205f10a4fe4ea091d7ba4, disabling compactions & flushes 2023-02-07 19:03:27,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. after waiting 0 ms 2023-02-07 19:03:27,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,855 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c26d5c15bc003874209d12daf85c0ecf, regionState=CLOSED 2023-02-07 19:03:27,855 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607855"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607855"}]},"ts":"1675796607855"} 2023-02-07 19:03:27,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-07 19:03:27,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure daf3207a7c51268a4e55f4c6725ccbb5, server=jenkins-hbase6.apache.org,39905,1675796603102 in 170 msec 2023-02-07 19:03:27,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-07 19:03:27,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure c26d5c15bc003874209d12daf85c0ecf, server=jenkins-hbase6.apache.org,38215,1675796603132 in 167 msec 2023-02-07 19:03:27,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=daf3207a7c51268a4e55f4c6725ccbb5, UNASSIGN in 188 msec 2023-02-07 19:03:27,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c26d5c15bc003874209d12daf85c0ecf, UNASSIGN in 189 msec 2023-02-07 19:03:27,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000. 2023-02-07 19:03:27,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 0a1282db6180e4378a3c2c8042c3b000: Waiting for close lock at 1675796607853Running coprocessor pre-close hooks at 1675796607853Disabling compacts and flushes for region at 1675796607853Disabling writes for close at 1675796607853Writing region close event to WAL at 1675796607860 (+7 ms)Running coprocessor post-close hooks at 1675796607876 (+16 ms)Closed at 1675796607876 2023-02-07 19:03:27,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:27,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:27,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing bdf8583c738309b11b6482051ba12cac, disabling compactions & flushes 2023-02-07 19:03:27,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. after waiting 0 ms 2023-02-07 19:03:27,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,878 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=0a1282db6180e4378a3c2c8042c3b000, regionState=CLOSED 2023-02-07 19:03:27,878 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607878"}]},"ts":"1675796607878"} 2023-02-07 19:03:27,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4. 2023-02-07 19:03:27,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 9893dbb18eb205f10a4fe4ea091d7ba4: Waiting for close lock at 1675796607855Running coprocessor pre-close hooks at 1675796607855Disabling compacts and flushes for region at 1675796607855Disabling writes for close at 1675796607855Writing region close event to WAL at 1675796607875 (+20 ms)Running coprocessor post-close hooks at 1675796607879 (+4 ms)Closed at 1675796607879 2023-02-07 19:03:27,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:27,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:27,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing fa838629f0b995cf210d0cf657d72403, disabling compactions & flushes 2023-02-07 19:03:27,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. after waiting 0 ms 2023-02-07 19:03:27,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,881 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9893dbb18eb205f10a4fe4ea091d7ba4, regionState=CLOSED 2023-02-07 19:03:27,881 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607881"}]},"ts":"1675796607881"} 2023-02-07 19:03:27,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-07 19:03:27,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 0a1282db6180e4378a3c2c8042c3b000, server=jenkins-hbase6.apache.org,39905,1675796603102 in 194 msec 2023-02-07 19:03:27,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0a1282db6180e4378a3c2c8042c3b000, UNASSIGN in 209 msec 2023-02-07 19:03:27,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-07 19:03:27,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 9893dbb18eb205f10a4fe4ea091d7ba4, server=jenkins-hbase6.apache.org,38215,1675796603132 in 199 msec 2023-02-07 19:03:27,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9893dbb18eb205f10a4fe4ea091d7ba4, UNASSIGN in 211 msec 2023-02-07 19:03:27,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac. 2023-02-07 19:03:27,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for bdf8583c738309b11b6482051ba12cac: Waiting for close lock at 1675796607878Running coprocessor pre-close hooks at 1675796607878Disabling compacts and flushes for region at 1675796607878Disabling writes for close at 1675796607878Writing region close event to WAL at 1675796607887 (+9 ms)Running coprocessor post-close hooks at 1675796607895 (+8 ms)Closed at 1675796607895 2023-02-07 19:03:27,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:27,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:27,896 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=bdf8583c738309b11b6482051ba12cac, regionState=CLOSED 2023-02-07 19:03:27,896 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607896"}]},"ts":"1675796607896"} 2023-02-07 19:03:27,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403. 2023-02-07 19:03:27,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for fa838629f0b995cf210d0cf657d72403: Waiting for close lock at 1675796607881Running coprocessor pre-close hooks at 1675796607881Disabling compacts and flushes for region at 1675796607881Disabling writes for close at 1675796607881Writing region close event to WAL at 1675796607893 (+12 ms)Running coprocessor post-close hooks at 1675796607897 (+4 ms)Closed at 1675796607897 2023-02-07 19:03:27,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:27,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fa838629f0b995cf210d0cf657d72403, regionState=CLOSED 2023-02-07 19:03:27,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675796607899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796607899"}]},"ts":"1675796607899"} 2023-02-07 19:03:27,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-07 19:03:27,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure bdf8583c738309b11b6482051ba12cac, server=jenkins-hbase6.apache.org,39905,1675796603102 in 221 msec 2023-02-07 19:03:27,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bdf8583c738309b11b6482051ba12cac, UNASSIGN in 226 msec 2023-02-07 19:03:27,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-07 19:03:27,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure fa838629f0b995cf210d0cf657d72403, server=jenkins-hbase6.apache.org,38215,1675796603132 in 221 msec 2023-02-07 19:03:27,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-07 19:03:27,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fa838629f0b995cf210d0cf657d72403, UNASSIGN in 228 msec 2023-02-07 19:03:27,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796607903"}]},"ts":"1675796607903"} 2023-02-07 19:03:27,904 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-07 19:03:27,905 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-07 19:03:27,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 241 msec 2023-02-07 19:03:27,971 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,971 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 19:03:27,973 INFO [Listener at localhost/33873] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-07 19:03:27,973 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,973 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,974 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,976 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,976 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:27,976 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:27,977 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:27,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:27,987 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:27,992 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/recovered.edits] 2023-02-07 19:03:27,993 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/recovered.edits] 2023-02-07 19:03:27,993 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/recovered.edits] 2023-02-07 19:03:27,993 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/recovered.edits] 2023-02-07 19:03:27,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/recovered.edits] 2023-02-07 19:03:27,994 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/recovered.edits] 2023-02-07 19:03:27,995 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/recovered.edits] 2023-02-07 19:03:27,995 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/recovered.edits] 2023-02-07 19:03:28,003 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/1ea3242cbe204db9b49139df66976a43 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/1ea3242cbe204db9b49139df66976a43 2023-02-07 19:03:28,003 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/2a48996a7ecc49369776d03f0c8d98fa to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/2a48996a7ecc49369776d03f0c8d98fa 2023-02-07 19:03:28,003 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/995f9874dfba4e879b5c9fc5ed0abf04 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/995f9874dfba4e879b5c9fc5ed0abf04 2023-02-07 19:03:28,003 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/7197fb77b9a54008af69783495f7cf4b to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/7197fb77b9a54008af69783495f7cf4b 2023-02-07 19:03:28,003 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/09aa70a095b44a18a2c71e051b771e6c to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/09aa70a095b44a18a2c71e051b771e6c 2023-02-07 19:03:28,004 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/67a97b1cc1a04f44a1320fe12b940fc7 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/67a97b1cc1a04f44a1320fe12b940fc7 2023-02-07 19:03:28,004 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/b407b73bb79c415c839eb6454269928d to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/b407b73bb79c415c839eb6454269928d 2023-02-07 19:03:28,006 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/7cd692fdc22d41d1bc30c6075774f42f to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f1/7cd692fdc22d41d1bc30c6075774f42f 2023-02-07 19:03:28,006 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/73d5aeae95c74d50aed4a7365ce0d63e to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f1/73d5aeae95c74d50aed4a7365ce0d63e 2023-02-07 19:03:28,006 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/db0cc0d592b6490d8dbb3473eade5838 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f1/db0cc0d592b6490d8dbb3473eade5838 2023-02-07 19:03:28,007 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/9c28b3bfbb0d48a6ad5272ff199fdab3 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f1/9c28b3bfbb0d48a6ad5272ff199fdab3 2023-02-07 19:03:28,007 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/9a591b07279947beba6e02181634ad3b to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f1/9a591b07279947beba6e02181634ad3b 2023-02-07 19:03:28,007 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/955ace1484254f4bbba6795d61362ad9 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f1/955ace1484254f4bbba6795d61362ad9 2023-02-07 19:03:28,008 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/f93022244a564146aec027b8a6594538 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f1/f93022244a564146aec027b8a6594538 2023-02-07 19:03:28,008 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/recovered.edits/6.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f/recovered.edits/6.seqid 2023-02-07 19:03:28,010 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/39b48234deadf1be3f1db960ae42cc4f 2023-02-07 19:03:28,010 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:28,012 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/6bd1673a03304984aab96dabb3bbbf55 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/6bd1673a03304984aab96dabb3bbbf55 2023-02-07 19:03:28,013 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/3a06c1b5571e44d8ac9fa07455507e07 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/3a06c1b5571e44d8ac9fa07455507e07 2023-02-07 19:03:28,013 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/5f6a30c0549a4a2686de57e5c59f1fbc to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/5f6a30c0549a4a2686de57e5c59f1fbc 2023-02-07 19:03:28,014 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/57176193ea084ba3838f90b2819443a4 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/57176193ea084ba3838f90b2819443a4 2023-02-07 19:03:28,014 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/9c99e6590ddf4fd18b21a0bb0015286c to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/9c99e6590ddf4fd18b21a0bb0015286c 2023-02-07 19:03:28,014 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/753ad9b6c4e94e2db3bbd90b20b3d09d to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/753ad9b6c4e94e2db3bbd90b20b3d09d 2023-02-07 19:03:28,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/1ab6d067b8ad4bd7887107f1cd914fe3 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/1ab6d067b8ad4bd7887107f1cd914fe3 2023-02-07 19:03:28,015 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/8a56792ddfcf4f08bede87bb8deae3ea to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/f2/8a56792ddfcf4f08bede87bb8deae3ea 2023-02-07 19:03:28,015 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/recovered.edits] 2023-02-07 19:03:28,016 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/c4b48421328c4a0397cfb331c1cf0bd8 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/f2/c4b48421328c4a0397cfb331c1cf0bd8 2023-02-07 19:03:28,017 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/eb6e6fad3ba249b08a6dc8d42604eae9 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/f2/eb6e6fad3ba249b08a6dc8d42604eae9 2023-02-07 19:03:28,017 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/7317c96b53264643b2cac88cdf26ff7a to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/f2/7317c96b53264643b2cac88cdf26ff7a 2023-02-07 19:03:28,017 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/a888b44929564681921882115a0de1a0 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/f2/a888b44929564681921882115a0de1a0 2023-02-07 19:03:28,018 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/9056136757944035927de1c8323bbfda to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/f2/9056136757944035927de1c8323bbfda 2023-02-07 19:03:28,020 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5/recovered.edits/12.seqid 2023-02-07 19:03:28,021 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/daf3207a7c51268a4e55f4c6725ccbb5 2023-02-07 19:03:28,021 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:28,023 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0/recovered.edits/12.seqid 2023-02-07 19:03:28,023 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac/recovered.edits/12.seqid 2023-02-07 19:03:28,024 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4/recovered.edits/12.seqid 2023-02-07 19:03:28,027 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/bdf8583c738309b11b6482051ba12cac 2023-02-07 19:03:28,028 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c047b9d1f3594864142b8c14ceb7fcc0 2023-02-07 19:03:28,028 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/027d2ab880134ee19f0ec9f5b5bcab03 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/027d2ab880134ee19f0ec9f5b5bcab03 2023-02-07 19:03:28,028 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf/recovered.edits/12.seqid 2023-02-07 19:03:28,029 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/81aeaab4bdb8464ebfda13ea07b3a7d0 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/f2/81aeaab4bdb8464ebfda13ea07b3a7d0 2023-02-07 19:03:28,029 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/9893dbb18eb205f10a4fe4ea091d7ba4 2023-02-07 19:03:28,029 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000/recovered.edits/12.seqid 2023-02-07 19:03:28,029 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/c26d5c15bc003874209d12daf85c0ecf 2023-02-07 19:03:28,030 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f1, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/f2, FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/recovered.edits] 2023-02-07 19:03:28,030 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/0a1282db6180e4378a3c2c8042c3b000 2023-02-07 19:03:28,031 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/408229011e5e4a66bc6b70be3447ff8c to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f1/408229011e5e4a66bc6b70be3447ff8c 2023-02-07 19:03:28,034 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403/recovered.edits/12.seqid 2023-02-07 19:03:28,035 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/fa838629f0b995cf210d0cf657d72403 2023-02-07 19:03:28,036 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/36575b7ca34a4aae8896a3f2d6ba1166 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/36575b7ca34a4aae8896a3f2d6ba1166 2023-02-07 19:03:28,038 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/98340c184e2d4fd89ec8a7b6b0e63626 to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/f2/98340c184e2d4fd89ec8a7b6b0e63626 2023-02-07 19:03:28,039 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/recovered.edits/6.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d/recovered.edits/6.seqid 2023-02-07 19:03:28,040 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/789c6678a6e90e3be1c5e0c9820bc03d 2023-02-07 19:03:28,042 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/recovered.edits/12.seqid to hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/archive/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d/recovered.edits/12.seqid 2023-02-07 19:03:28,043 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d40ee3354df51986b3e8ae536d1c3d7d 2023-02-07 19:03:28,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-07 19:03:28,045 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:28,049 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-07 19:03:28,051 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,053 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796608052"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,055 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-07 19:03:28,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39b48234deadf1be3f1db960ae42cc4f, NAME => 'testWithMockedMapReduceMultiRegion,,1675796604446.39b48234deadf1be3f1db960ae42cc4f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => c047b9d1f3594864142b8c14ceb7fcc0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675796604446.c047b9d1f3594864142b8c14ceb7fcc0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => bdf8583c738309b11b6482051ba12cac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675796604446.bdf8583c738309b11b6482051ba12cac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => fa838629f0b995cf210d0cf657d72403, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675796604446.fa838629f0b995cf210d0cf657d72403.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => c26d5c15bc003874209d12daf85c0ecf, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675796604446.c26d5c15bc003874209d12daf85c0ecf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 0a1282db6180e4378a3c2c8042c3b000, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675796604446.0a1282db6180e4378a3c2c8042c3b000.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => daf3207a7c51268a4e55f4c6725ccbb5, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675796604446.daf3207a7c51268a4e55f4c6725ccbb5.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 9893dbb18eb205f10a4fe4ea091d7ba4, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675796604446.9893dbb18eb205f10a4fe4ea091d7ba4.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => d40ee3354df51986b3e8ae536d1c3d7d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675796604446.d40ee3354df51986b3e8ae536d1c3d7d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 789c6678a6e90e3be1c5e0c9820bc03d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675796604446.789c6678a6e90e3be1c5e0c9820bc03d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-07 19:03:28,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-07 19:03:28,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675796608055"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:28,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-07 19:03:28,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 19:03:28,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 84 msec 2023-02-07 19:03:28,078 INFO [Listener at localhost/33873] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:28,078 INFO [Listener at localhost/33873] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:28,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40849] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 19:03:28,079 INFO [Listener at localhost/33873] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-07 19:03:28,079 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:28,080 INFO [Listener at localhost/33873] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:28,080 DEBUG [Listener at localhost/33873] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74c057b3 to 127.0.0.1:52948 2023-02-07 19:03:28,080 DEBUG [Listener at localhost/33873] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,080 DEBUG [Listener at localhost/33873] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:28,080 DEBUG [Listener at localhost/33873] util.JVMClusterUtil(257): Found active master hash=1031963856, stopped=false 2023-02-07 19:03:28,080 INFO [Listener at localhost/33873] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:28,084 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:28,084 INFO [Listener at localhost/33873] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:28,084 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:28,084 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:28,084 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:28,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:28,086 DEBUG [Listener at localhost/33873] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75c1796d to 127.0.0.1:52948 2023-02-07 19:03:28,086 DEBUG [Listener at localhost/33873] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:28,086 INFO [Listener at localhost/33873] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39905,1675796603102' ***** 2023-02-07 19:03:28,086 INFO [Listener at localhost/33873] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:28,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:28,086 INFO [RS:0;jenkins-hbase6:39905] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:28,086 INFO [RS:0;jenkins-hbase6:39905] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:28,087 INFO [RS:0;jenkins-hbase6:39905] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:28,087 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:28,087 DEBUG [RS:0;jenkins-hbase6:39905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7900df2b to 127.0.0.1:52948 2023-02-07 19:03:28,087 DEBUG [RS:0;jenkins-hbase6:39905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,086 INFO [Listener at localhost/33873] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,38215,1675796603132' ***** 2023-02-07 19:03:28,087 INFO [RS:0;jenkins-hbase6:39905] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:28,087 INFO [RS:0;jenkins-hbase6:39905] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:28,087 INFO [RS:0;jenkins-hbase6:39905] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:28,086 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:28,087 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:28,087 INFO [Listener at localhost/33873] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:28,088 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 19:03:28,088 INFO [RS:1;jenkins-hbase6:38215] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:28,088 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 19:03:28,089 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:28,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:28,089 DEBUG [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 19:03:28,089 INFO [RS:1;jenkins-hbase6:38215] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:28,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:28,090 INFO [RS:1;jenkins-hbase6:38215] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:28,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:28,090 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(3304): Received CLOSE for ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:28,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:28,090 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:28,090 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:28,090 DEBUG [RS:1;jenkins-hbase6:38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54f45ef2 to 127.0.0.1:52948 2023-02-07 19:03:28,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-07 19:03:28,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing ed67c41b811c3dbe55461d0799384ce1, disabling compactions & flushes 2023-02-07 19:03:28,092 DEBUG [RS:1;jenkins-hbase6:38215] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:28,093 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 19:03:28,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:28,093 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1479): Online Regions={ed67c41b811c3dbe55461d0799384ce1=hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1.} 2023-02-07 19:03:28,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. after waiting 0 ms 2023-02-07 19:03:28,093 DEBUG [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1505): Waiting on ed67c41b811c3dbe55461d0799384ce1 2023-02-07 19:03:28,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:28,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing ed67c41b811c3dbe55461d0799384ce1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:28,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/.tmp/info/91bd63e632f04a2b951f51441d261194 2023-02-07 19:03:28,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/.tmp/info/f2f7a988530e4d8c9bcfbba3961c1c09 2023-02-07 19:03:28,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91bd63e632f04a2b951f51441d261194 2023-02-07 19:03:28,106 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:28,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/.tmp/info/f2f7a988530e4d8c9bcfbba3961c1c09 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/info/f2f7a988530e4d8c9bcfbba3961c1c09 2023-02-07 19:03:28,107 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:28,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/info/f2f7a988530e4d8c9bcfbba3961c1c09, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:28,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ed67c41b811c3dbe55461d0799384ce1 in 20ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:28,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/.tmp/rep_barrier/7365a7cc8fa14fd6899219e0a2f5d097 2023-02-07 19:03:28,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/namespace/ed67c41b811c3dbe55461d0799384ce1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:28,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:28,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for ed67c41b811c3dbe55461d0799384ce1: Waiting for close lock at 1675796608090Running coprocessor pre-close hooks at 1675796608090Disabling compacts and flushes for region at 1675796608090Disabling writes for close at 1675796608093 (+3 ms)Obtaining lock to block concurrent updates at 1675796608093Preparing flush snapshotting stores in ed67c41b811c3dbe55461d0799384ce1 at 1675796608093Finished memstore snapshotting hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796608093Flushing stores of hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. at 1675796608094 (+1 ms)Flushing ed67c41b811c3dbe55461d0799384ce1/info: creating writer at 1675796608094Flushing ed67c41b811c3dbe55461d0799384ce1/info: appending metadata at 1675796608096 (+2 ms)Flushing ed67c41b811c3dbe55461d0799384ce1/info: closing flushed file at 1675796608096Flushing ed67c41b811c3dbe55461d0799384ce1/info: reopening flushed file at 1675796608109 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ed67c41b811c3dbe55461d0799384ce1 in 20ms, sequenceid=6, compaction requested=false at 1675796608113 (+4 ms)Writing region close event to WAL at 1675796608119 (+6 ms)Running coprocessor post-close hooks at 1675796608122 (+3 ms)Closed at 1675796608122 2023-02-07 19:03:28,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796603840.ed67c41b811c3dbe55461d0799384ce1. 2023-02-07 19:03:28,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7365a7cc8fa14fd6899219e0a2f5d097 2023-02-07 19:03:28,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/.tmp/table/db1d135549524baab2e74ef9432c0d06 2023-02-07 19:03:28,136 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db1d135549524baab2e74ef9432c0d06 2023-02-07 19:03:28,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/.tmp/info/91bd63e632f04a2b951f51441d261194 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/info/91bd63e632f04a2b951f51441d261194 2023-02-07 19:03:28,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91bd63e632f04a2b951f51441d261194 2023-02-07 19:03:28,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/info/91bd63e632f04a2b951f51441d261194, entries=30, sequenceid=57, filesize=8.3 K 2023-02-07 19:03:28,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/.tmp/rep_barrier/7365a7cc8fa14fd6899219e0a2f5d097 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/rep_barrier/7365a7cc8fa14fd6899219e0a2f5d097 2023-02-07 19:03:28,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7365a7cc8fa14fd6899219e0a2f5d097 2023-02-07 19:03:28,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/rep_barrier/7365a7cc8fa14fd6899219e0a2f5d097, entries=10, sequenceid=57, filesize=6.1 K 2023-02-07 19:03:28,146 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/.tmp/table/db1d135549524baab2e74ef9432c0d06 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/table/db1d135549524baab2e74ef9432c0d06 2023-02-07 19:03:28,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for db1d135549524baab2e74ef9432c0d06 2023-02-07 19:03:28,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/table/db1d135549524baab2e74ef9432c0d06, entries=13, sequenceid=57, filesize=6.1 K 2023-02-07 19:03:28,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=57, compaction requested=false 2023-02-07 19:03:28,154 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-07 19:03:28,155 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:28,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:28,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796608089Running coprocessor pre-close hooks at 1675796608089Disabling compacts and flushes for region at 1675796608089Disabling writes for close at 1675796608090 (+1 ms)Obtaining lock to block concurrent updates at 1675796608092 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1675796608092Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675796608093 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675796608093Flushing 1588230740/info: creating writer at 1675796608093Flushing 1588230740/info: appending metadata at 1675796608096 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675796608096Flushing 1588230740/rep_barrier: creating writer at 1675796608106 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675796608110 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675796608111 (+1 ms)Flushing 1588230740/table: creating writer at 1675796608125 (+14 ms)Flushing 1588230740/table: appending metadata at 1675796608127 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796608127Flushing 1588230740/info: reopening flushed file at 1675796608137 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675796608141 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675796608146 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=57, compaction requested=false at 1675796608150 (+4 ms)Writing region close event to WAL at 1675796608151 (+1 ms)Running coprocessor post-close hooks at 1675796608155 (+4 ms)Closed at 1675796608156 (+1 ms) 2023-02-07 19:03:28,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:28,290 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39905,1675796603102; all regions closed. 2023-02-07 19:03:28,293 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,38215,1675796603132; all regions closed. 2023-02-07 19:03:28,301 DEBUG [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/oldWALs 2023-02-07 19:03:28,301 INFO [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39905%2C1675796603102.meta:.meta(num 1675796603735) 2023-02-07 19:03:28,301 DEBUG [RS:1;jenkins-hbase6:38215] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/oldWALs 2023-02-07 19:03:28,302 INFO [RS:1;jenkins-hbase6:38215] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C38215%2C1675796603132:(num 1675796604214) 2023-02-07 19:03:28,302 DEBUG [RS:1;jenkins-hbase6:38215] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,302 INFO [RS:1;jenkins-hbase6:38215] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:28,302 INFO [RS:1;jenkins-hbase6:38215] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:28,302 INFO [RS:1;jenkins-hbase6:38215] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:28,302 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:28,302 INFO [RS:1;jenkins-hbase6:38215] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:28,302 INFO [RS:1;jenkins-hbase6:38215] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:28,303 INFO [RS:1;jenkins-hbase6:38215] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:38215 2023-02-07 19:03:28,305 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/WALs/jenkins-hbase6.apache.org,39905,1675796603102/jenkins-hbase6.apache.org%2C39905%2C1675796603102.1675796604531 not finished, retry = 0 2023-02-07 19:03:28,306 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:28,306 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,38215,1675796603132 2023-02-07 19:03:28,306 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:28,306 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2433bccd rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,306 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:28,307 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:28,307 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d4d3eeb rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,308 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,38215,1675796603132] 2023-02-07 19:03:28,308 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,38215,1675796603132; numProcessing=1 2023-02-07 19:03:28,309 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,38215,1675796603132 already deleted, retry=false 2023-02-07 19:03:28,309 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,38215,1675796603132 expired; onlineServers=1 2023-02-07 19:03:28,407 DEBUG [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/oldWALs 2023-02-07 19:03:28,407 INFO [RS:0;jenkins-hbase6:39905] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39905%2C1675796603102:(num 1675796604531) 2023-02-07 19:03:28,407 DEBUG [RS:0;jenkins-hbase6:39905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,407 INFO [RS:0;jenkins-hbase6:39905] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:28,407 INFO [RS:0;jenkins-hbase6:39905] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:28,407 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:28,409 INFO [RS:0;jenkins-hbase6:39905] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39905 2023-02-07 19:03:28,410 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:28,410 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39905,1675796603102 2023-02-07 19:03:28,410 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@126c4ce5 rejected from java.util.concurrent.ThreadPoolExecutor@1653ca70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,415 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,39905,1675796603102] 2023-02-07 19:03:28,415 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,39905,1675796603102; numProcessing=2 2023-02-07 19:03:28,416 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,39905,1675796603102 already deleted, retry=false 2023-02-07 19:03:28,416 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,39905,1675796603102 expired; onlineServers=0 2023-02-07 19:03:28,416 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,40849,1675796603055' ***** 2023-02-07 19:03:28,416 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:28,417 DEBUG [M:0;jenkins-hbase6:40849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39bd07b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:28,417 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,40849,1675796603055 2023-02-07 19:03:28,417 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,40849,1675796603055; all regions closed. 2023-02-07 19:03:28,417 DEBUG [M:0;jenkins-hbase6:40849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:28,417 DEBUG [M:0;jenkins-hbase6:40849] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:28,417 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:28,417 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796603377] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796603377,5,FailOnTimeoutGroup] 2023-02-07 19:03:28,417 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796603374] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796603374,5,FailOnTimeoutGroup] 2023-02-07 19:03:28,417 DEBUG [M:0;jenkins-hbase6:40849] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:28,418 INFO [M:0;jenkins-hbase6:40849] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:28,418 INFO [M:0;jenkins-hbase6:40849] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:28,418 INFO [M:0;jenkins-hbase6:40849] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:28,419 DEBUG [M:0;jenkins-hbase6:40849] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:28,419 INFO [M:0;jenkins-hbase6:40849] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:28,419 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:28,419 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:28,419 ERROR [M:0;jenkins-hbase6:40849] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 19:03:28,419 INFO [M:0;jenkins-hbase6:40849] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:28,419 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:28,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:28,420 DEBUG [M:0;jenkins-hbase6:40849] zookeeper.ZKUtil(398): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:28,420 WARN [M:0;jenkins-hbase6:40849] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:28,420 INFO [M:0;jenkins-hbase6:40849] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:28,420 INFO [M:0;jenkins-hbase6:40849] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:28,420 DEBUG [M:0;jenkins-hbase6:40849] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:28,421 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:28,421 DEBUG [M:0;jenkins-hbase6:40849] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:28,421 DEBUG [M:0;jenkins-hbase6:40849] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:28,421 DEBUG [M:0;jenkins-hbase6:40849] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:28,421 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.15 KB heapSize=200.04 KB 2023-02-07 19:03:28,429 INFO [M:0;jenkins-hbase6:40849] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.15 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/70a2de6d4a804de096dde7c7d2692d03 2023-02-07 19:03:28,433 DEBUG [M:0;jenkins-hbase6:40849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/70a2de6d4a804de096dde7c7d2692d03 as hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/70a2de6d4a804de096dde7c7d2692d03 2023-02-07 19:03:28,436 INFO [M:0;jenkins-hbase6:40849] regionserver.HStore(1080): Added hdfs://localhost:44889/user/jenkins/test-data/8ef5bfd6-f06f-904b-a515-65a36a2ad62d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/70a2de6d4a804de096dde7c7d2692d03, entries=53, sequenceid=357, filesize=10.7 K 2023-02-07 19:03:28,437 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegion(2947): Finished flush of dataSize ~167.15 KB/171161, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-07 19:03:28,437 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:28,438 DEBUG [M:0;jenkins-hbase6:40849] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796608420Disabling compacts and flushes for region at 1675796608420Disabling writes for close at 1675796608421 (+1 ms)Obtaining lock to block concurrent updates at 1675796608421Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796608421Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171161, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675796608421Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796608422 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796608422Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796608424 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796608424Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796608433 (+9 ms)Finished flush of dataSize ~167.15 KB/171161, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1675796608437 (+4 ms)Writing region close event to WAL at 1675796608437Closed at 1675796608437 2023-02-07 19:03:28,440 INFO [M:0;jenkins-hbase6:40849] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:28,440 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:28,441 INFO [M:0;jenkins-hbase6:40849] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:40849 2023-02-07 19:03:28,443 DEBUG [M:0;jenkins-hbase6:40849] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,40849,1675796603055 already deleted, retry=false 2023-02-07 19:03:28,586 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:28,586 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@439b4b9c rejected from java.util.concurrent.ThreadPoolExecutor@47a4d737[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,586 INFO [M:0;jenkins-hbase6:40849] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,40849,1675796603055; zookeeper connection closed. 2023-02-07 19:03:28,587 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): master:40849-0x1013e9814e00000, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:28,588 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ab06b30 rejected from java.util.concurrent.ThreadPoolExecutor@47a4d737[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,686 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:28,686 INFO [RS:0;jenkins-hbase6:39905] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39905,1675796603102; zookeeper connection closed. 2023-02-07 19:03:28,687 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12334e15 rejected from java.util.concurrent.ThreadPoolExecutor@1653ca70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,687 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18ae283e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18ae283e 2023-02-07 19:03:28,687 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:39905-0x1013e9814e00001, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:28,687 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ac065a1 rejected from java.util.concurrent.ThreadPoolExecutor@1653ca70[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,787 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:28,787 INFO [RS:1;jenkins-hbase6:38215] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,38215,1675796603132; zookeeper connection closed. 2023-02-07 19:03:28,787 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1508e4e8 rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,787 DEBUG [Listener at localhost/33873-EventThread] zookeeper.ZKWatcher(600): regionserver:38215-0x1013e9814e00002, quorum=127.0.0.1:52948, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:28,787 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@16698195] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@16698195 2023-02-07 19:03:28,787 ERROR [Listener at localhost/33873-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19f9590 rejected from java.util.concurrent.ThreadPoolExecutor@200c2c93[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:28,787 INFO [Listener at localhost/33873] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:28,788 WARN [Listener at localhost/33873] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:28,791 INFO [Listener at localhost/33873] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:28,898 WARN [BP-975538014-172.31.2.20-1675796602373 heartbeating to localhost/127.0.0.1:44889] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:28,898 WARN [BP-975538014-172.31.2.20-1675796602373 heartbeating to localhost/127.0.0.1:44889] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-975538014-172.31.2.20-1675796602373 (Datanode Uuid 38af3cbe-0d28-47f3-92e6-bf8e8aea12e4) service to localhost/127.0.0.1:44889 2023-02-07 19:03:28,899 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/dfs/data/data3/current/BP-975538014-172.31.2.20-1675796602373] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:28,899 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/dfs/data/data4/current/BP-975538014-172.31.2.20-1675796602373] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:28,901 WARN [Listener at localhost/33873] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:28,904 INFO [Listener at localhost/33873] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:29,010 WARN [BP-975538014-172.31.2.20-1675796602373 heartbeating to localhost/127.0.0.1:44889] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:29,011 WARN [BP-975538014-172.31.2.20-1675796602373 heartbeating to localhost/127.0.0.1:44889] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-975538014-172.31.2.20-1675796602373 (Datanode Uuid f8bd856d-5873-43ce-90ff-8ddb32750e8d) service to localhost/127.0.0.1:44889 2023-02-07 19:03:29,014 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/dfs/data/data1/current/BP-975538014-172.31.2.20-1675796602373] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:29,014 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/cluster_cee3a49d-8941-3390-4baf-ac3a8f4c6f2e/dfs/data/data2/current/BP-975538014-172.31.2.20-1675796602373] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:29,025 INFO [Listener at localhost/33873] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:29,144 INFO [Listener at localhost/33873] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:29,180 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:29,195 INFO [Listener at localhost/33873] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,40849,1675796603055)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:44889 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44889 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44889 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:44889 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44889 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33873.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=649 (was 576) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=349 (was 361), ProcessCount=169 (was 169), AvailableMemoryMB=4777 (was 4828) 2023-02-07 19:03:29,205 INFO [Listener at localhost/33873] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=349, ProcessCount=169, AvailableMemoryMB=4776 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/hadoop.log.dir so I do NOT create it in target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2 2023-02-07 19:03:29,216 WARN [Listener at localhost/33873] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/hadoop.tmp.dir so I do NOT create it in target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2 2023-02-07 19:03:29,216 WARN [Listener at localhost/33873] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/64955954-9512-f09a-22e6-d089d8222f7d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 19:03:29,216 DEBUG [Listener at localhost/33873] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d, deleteOnExit=true 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/test.cache.data in system properties and HBase conf 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:03:29,216 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:03:29,217 DEBUG [Listener at localhost/33873] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:03:29,217 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:03:29,218 INFO [Listener at localhost/33873] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:03:29,222 WARN [Listener at localhost/33873] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:29,222 WARN [Listener at localhost/33873] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:29,257 WARN [Listener at localhost/33873] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 19:03:29,316 WARN [Listener at localhost/33873] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:29,318 INFO [Listener at localhost/33873] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:29,322 INFO [Listener at localhost/33873] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/java.io.tmpdir/Jetty_localhost_34195_hdfs____.8f4r4a/webapp 2023-02-07 19:03:29,414 INFO [Listener at localhost/33873] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34195 2023-02-07 19:03:29,418 WARN [Listener at localhost/33873] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:29,418 WARN [Listener at localhost/33873] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:29,734 WARN [Listener at localhost/44947] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:29,746 WARN [Listener at localhost/44947] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:29,748 WARN [Listener at localhost/44947] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:29,749 INFO [Listener at localhost/44947] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:29,754 INFO [Listener at localhost/44947] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/java.io.tmpdir/Jetty_localhost_41891_datanode____.i0cnvq/webapp 2023-02-07 19:03:29,850 INFO [Listener at localhost/44947] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41891 2023-02-07 19:03:29,863 WARN [Listener at localhost/42501] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:29,883 WARN [Listener at localhost/42501] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:29,885 WARN [Listener at localhost/42501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:29,886 INFO [Listener at localhost/42501] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:29,890 INFO [Listener at localhost/42501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/java.io.tmpdir/Jetty_localhost_40359_datanode____2gjz42/webapp 2023-02-07 19:03:29,999 INFO [Listener at localhost/42501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40359 2023-02-07 19:03:30,007 WARN [Listener at localhost/39203] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:32,342 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf87a91b3e66cddd: Processing first storage report for DS-81c29e73-6ea3-4472-8f0c-488d52539dc3 from datanode 9d51d72c-1050-4983-9ba7-472bda8ecb9a 2023-02-07 19:03:32,342 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf87a91b3e66cddd: from storage DS-81c29e73-6ea3-4472-8f0c-488d52539dc3 node DatanodeRegistration(127.0.0.1:35531, datanodeUuid=9d51d72c-1050-4983-9ba7-472bda8ecb9a, infoPort=33333, infoSecurePort=0, ipcPort=42501, storageInfo=lv=-57;cid=testClusterID;nsid=1822025312;c=1675796609224), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:32,342 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdf87a91b3e66cddd: Processing first storage report for DS-71badcf9-de4b-473e-9b4c-1dead01745c2 from datanode 9d51d72c-1050-4983-9ba7-472bda8ecb9a 2023-02-07 19:03:32,342 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdf87a91b3e66cddd: from storage DS-71badcf9-de4b-473e-9b4c-1dead01745c2 node DatanodeRegistration(127.0.0.1:35531, datanodeUuid=9d51d72c-1050-4983-9ba7-472bda8ecb9a, infoPort=33333, infoSecurePort=0, ipcPort=42501, storageInfo=lv=-57;cid=testClusterID;nsid=1822025312;c=1675796609224), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:32,559 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f40073700c04e03: Processing first storage report for DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3 from datanode 9b898dc7-6c36-488d-860e-b2eba8c77ed3 2023-02-07 19:03:32,559 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f40073700c04e03: from storage DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3 node DatanodeRegistration(127.0.0.1:46113, datanodeUuid=9b898dc7-6c36-488d-860e-b2eba8c77ed3, infoPort=33145, infoSecurePort=0, ipcPort=39203, storageInfo=lv=-57;cid=testClusterID;nsid=1822025312;c=1675796609224), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:32,560 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f40073700c04e03: Processing first storage report for DS-4d1caa2c-055f-4387-86e9-e8aef80c3a45 from datanode 9b898dc7-6c36-488d-860e-b2eba8c77ed3 2023-02-07 19:03:32,560 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f40073700c04e03: from storage DS-4d1caa2c-055f-4387-86e9-e8aef80c3a45 node DatanodeRegistration(127.0.0.1:46113, datanodeUuid=9b898dc7-6c36-488d-860e-b2eba8c77ed3, infoPort=33145, infoSecurePort=0, ipcPort=39203, storageInfo=lv=-57;cid=testClusterID;nsid=1822025312;c=1675796609224), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:32,639 DEBUG [Listener at localhost/39203] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2 2023-02-07 19:03:32,654 INFO [Listener at localhost/39203] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/zookeeper_0, clientPort=51148, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:03:32,655 INFO [Listener at localhost/39203] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51148 2023-02-07 19:03:32,655 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:32,656 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:32,667 INFO [Listener at localhost/39203] util.FSUtils(479): Created version file at hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf with version=8 2023-02-07 19:03:32,668 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:32,669 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:32,670 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/hbase-staging 2023-02-07 19:03:32,672 INFO [Listener at localhost/39203] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:32,672 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:32,672 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:32,672 INFO [Listener at localhost/39203] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:32,673 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:32,673 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:32,673 INFO [Listener at localhost/39203] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:32,673 INFO [Listener at localhost/39203] ipc.NettyRpcServer(120): Bind to /172.31.2.20:34673 2023-02-07 19:03:32,674 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:32,675 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:32,676 INFO [Listener at localhost/39203] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34673 connecting to ZooKeeper ensemble=127.0.0.1:51148 2023-02-07 19:03:33,008 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:346730x0, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:33,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34673-0x1013e983a730000 connected 2023-02-07 19:03:33,215 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:33,216 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:33,216 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:33,217 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34673 2023-02-07 19:03:33,217 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34673 2023-02-07 19:03:33,217 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34673 2023-02-07 19:03:33,218 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34673 2023-02-07 19:03:33,218 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34673 2023-02-07 19:03:33,218 INFO [Listener at localhost/39203] master.HMaster(439): hbase.rootdir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf, hbase.cluster.distributed=false 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:33,230 INFO [Listener at localhost/39203] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:33,231 INFO [Listener at localhost/39203] ipc.NettyRpcServer(120): Bind to /172.31.2.20:35921 2023-02-07 19:03:33,231 INFO [Listener at localhost/39203] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:33,233 DEBUG [Listener at localhost/39203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:33,234 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:33,235 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:33,236 INFO [Listener at localhost/39203] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35921 connecting to ZooKeeper ensemble=127.0.0.1:51148 2023-02-07 19:03:33,240 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:359210x0, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:33,241 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): regionserver:359210x0, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:33,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35921-0x1013e983a730001 connected 2023-02-07 19:03:33,241 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:33,242 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:33,244 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35921 2023-02-07 19:03:33,246 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35921 2023-02-07 19:03:33,246 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35921 2023-02-07 19:03:33,247 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35921 2023-02-07 19:03:33,247 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35921 2023-02-07 19:03:33,257 INFO [Listener at localhost/39203] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:33,257 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:33,258 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:33,258 INFO [Listener at localhost/39203] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:33,258 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:33,258 INFO [Listener at localhost/39203] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:33,258 INFO [Listener at localhost/39203] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:33,259 INFO [Listener at localhost/39203] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44919 2023-02-07 19:03:33,259 INFO [Listener at localhost/39203] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:33,260 DEBUG [Listener at localhost/39203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:33,260 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:33,261 INFO [Listener at localhost/39203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:33,262 INFO [Listener at localhost/39203] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44919 connecting to ZooKeeper ensemble=127.0.0.1:51148 2023-02-07 19:03:33,266 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:449190x0, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:33,267 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): regionserver:449190x0, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:33,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44919-0x1013e983a730002 connected 2023-02-07 19:03:33,268 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:33,268 DEBUG [Listener at localhost/39203] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:33,273 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44919 2023-02-07 19:03:33,274 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44919 2023-02-07 19:03:33,274 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44919 2023-02-07 19:03:33,274 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44919 2023-02-07 19:03:33,275 DEBUG [Listener at localhost/39203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44919 2023-02-07 19:03:33,276 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,278 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:33,279 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,280 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:33,280 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:33,280 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:33,281 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,282 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:33,283 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,34673,1675796612671 from backup master directory 2023-02-07 19:03:33,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:33,284 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,285 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:33,285 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:33,285 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,295 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/hbase.id with ID: d6a13369-844a-430f-b375-ab9f407098db 2023-02-07 19:03:33,301 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:33,303 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,309 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6066d5bd to 127.0.0.1:51148 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:33,313 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d6bd0e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:33,313 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:33,314 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:03:33,314 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:33,315 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store-tmp 2023-02-07 19:03:33,320 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:33,320 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:33,320 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:33,320 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:33,321 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:33,321 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:33,321 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:33,321 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796613320Disabling compacts and flushes for region at 1675796613320Disabling writes for close at 1675796613321 (+1 ms)Writing region close event to WAL at 1675796613321Closed at 1675796613321 2023-02-07 19:03:33,321 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/WALs/jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,323 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C34673%2C1675796612671, suffix=, logDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/WALs/jenkins-hbase6.apache.org,34673,1675796612671, archiveDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/oldWALs, maxLogs=10 2023-02-07 19:03:33,342 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK] 2023-02-07 19:03:33,343 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK] 2023-02-07 19:03:33,345 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/WALs/jenkins-hbase6.apache.org,34673,1675796612671/jenkins-hbase6.apache.org%2C34673%2C1675796612671.1675796613323 2023-02-07 19:03:33,345 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK], DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK]] 2023-02-07 19:03:33,345 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:33,345 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:33,345 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:33,345 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:33,346 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:33,347 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:03:33,347 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:03:33,348 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,348 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:33,349 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:33,351 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:33,352 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:33,352 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65344059, jitterRate=-0.026297643780708313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:33,352 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796613345Initializing all the Stores at 1675796613346 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796613346Cleaning up temporary data from old regions at 1675796613349 (+3 ms)Cleaning up detritus from prior splits at 1675796613349Region opened successfully at 1675796613352 (+3 ms) 2023-02-07 19:03:33,353 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:03:33,353 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:03:33,354 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:03:33,354 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:03:33,354 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 19:03:33,354 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 19:03:33,354 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:03:33,355 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:03:33,356 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:03:33,370 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:03:33,370 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:03:33,371 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:03:33,371 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:03:33,371 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:03:33,373 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,373 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:03:33,373 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:03:33,374 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:03:33,376 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:33,376 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:33,376 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:33,376 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,376 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,34673,1675796612671, sessionid=0x1013e983a730000, setting cluster-up flag (Was=false) 2023-02-07 19:03:33,381 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,385 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:03:33,386 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,390 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,395 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:03:33,395 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:33,396 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.hbase-snapshot/.tmp 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:33,397 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796643399 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:03:33,399 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:03:33,399 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:03:33,399 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,400 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:03:33,400 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:03:33,400 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:03:33,400 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:33,400 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:03:33,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:03:33,401 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796613401,5,FailOnTimeoutGroup] 2023-02-07 19:03:33,401 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796613401,5,FailOnTimeoutGroup] 2023-02-07 19:03:33,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:03:33,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,401 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,413 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:33,413 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:33,413 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf 2023-02-07 19:03:33,419 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:33,420 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:33,421 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/info 2023-02-07 19:03:33,421 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:33,422 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,422 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:33,423 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:33,423 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:33,423 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:33,424 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/table 2023-02-07 19:03:33,425 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:33,425 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,426 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740 2023-02-07 19:03:33,426 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740 2023-02-07 19:03:33,428 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:33,428 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:33,430 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:33,430 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69040901, jitterRate=0.028789594769477844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:33,430 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796613419Initializing all the Stores at 1675796613420 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796613420Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796613420Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796613420Cleaning up temporary data from old regions at 1675796613427 (+7 ms)Cleaning up detritus from prior splits at 1675796613427Region opened successfully at 1675796613430 (+3 ms) 2023-02-07 19:03:33,431 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:33,431 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:33,431 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:33,431 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:33,431 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:33,431 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:33,431 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796613431Disabling compacts and flushes for region at 1675796613431Disabling writes for close at 1675796613431Writing region close event to WAL at 1675796613431Closed at 1675796613431 2023-02-07 19:03:33,432 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:33,432 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:03:33,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:03:33,433 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:03:33,435 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:03:33,477 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(952): ClusterId : d6a13369-844a-430f-b375-ab9f407098db 2023-02-07 19:03:33,477 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(952): ClusterId : d6a13369-844a-430f-b375-ab9f407098db 2023-02-07 19:03:33,477 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:33,477 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:33,479 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:33,479 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:33,479 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:33,479 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:33,481 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:33,483 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:33,483 DEBUG [RS:1;jenkins-hbase6:44919] zookeeper.ReadOnlyZKClient(139): Connect 0x4684dd9c to 127.0.0.1:51148 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:33,484 DEBUG [RS:0;jenkins-hbase6:35921] zookeeper.ReadOnlyZKClient(139): Connect 0x1909672d to 127.0.0.1:51148 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:33,490 DEBUG [RS:1;jenkins-hbase6:44919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48432b3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:33,490 DEBUG [RS:0;jenkins-hbase6:35921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17ce8a7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:33,490 DEBUG [RS:1;jenkins-hbase6:44919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c7cb6ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:33,490 DEBUG [RS:0;jenkins-hbase6:35921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13f10c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:33,504 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:35921 2023-02-07 19:03:33,504 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:44919 2023-02-07 19:03:33,504 INFO [RS:0;jenkins-hbase6:35921] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:33,504 INFO [RS:0;jenkins-hbase6:35921] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:33,504 INFO [RS:1;jenkins-hbase6:44919] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:33,504 INFO [RS:1;jenkins-hbase6:44919] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:33,504 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:33,504 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:33,504 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,34673,1675796612671 with isa=jenkins-hbase6.apache.org/172.31.2.20:35921, startcode=1675796613230 2023-02-07 19:03:33,504 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,34673,1675796612671 with isa=jenkins-hbase6.apache.org/172.31.2.20:44919, startcode=1675796613257 2023-02-07 19:03:33,504 DEBUG [RS:0;jenkins-hbase6:35921] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:33,504 DEBUG [RS:1;jenkins-hbase6:44919] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:33,506 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36165, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:33,506 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:40073, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:33,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34673] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,507 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,508 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf 2023-02-07 19:03:33,508 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf 2023-02-07 19:03:33,508 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44947 2023-02-07 19:03:33,508 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44947 2023-02-07 19:03:33,508 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:33,508 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:33,513 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:33,513 DEBUG [RS:0;jenkins-hbase6:35921] zookeeper.ZKUtil(162): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,514 DEBUG [RS:1;jenkins-hbase6:44919] zookeeper.ZKUtil(162): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,514 WARN [RS:0;jenkins-hbase6:35921] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:33,514 WARN [RS:1;jenkins-hbase6:44919] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:33,514 INFO [RS:0;jenkins-hbase6:35921] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:33,514 INFO [RS:1;jenkins-hbase6:44919] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:33,514 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,514 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,514 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,35921,1675796613230] 2023-02-07 19:03:33,514 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44919,1675796613257] 2023-02-07 19:03:33,519 DEBUG [RS:0;jenkins-hbase6:35921] zookeeper.ZKUtil(162): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,519 DEBUG [RS:1;jenkins-hbase6:44919] zookeeper.ZKUtil(162): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,519 DEBUG [RS:0;jenkins-hbase6:35921] zookeeper.ZKUtil(162): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,519 DEBUG [RS:1;jenkins-hbase6:44919] zookeeper.ZKUtil(162): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,520 DEBUG [RS:0;jenkins-hbase6:35921] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:33,520 INFO [RS:0;jenkins-hbase6:35921] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:33,520 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:33,521 INFO [RS:1;jenkins-hbase6:44919] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:33,522 INFO [RS:0;jenkins-hbase6:35921] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:33,522 INFO [RS:1;jenkins-hbase6:44919] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:33,523 INFO [RS:0;jenkins-hbase6:35921] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:33,523 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,523 INFO [RS:1;jenkins-hbase6:44919] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:33,523 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,523 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:33,524 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:33,524 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,525 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,525 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,525 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,525 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,525 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:0;jenkins-hbase6:35921] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,526 DEBUG [RS:1;jenkins-hbase6:44919] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:33,527 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,527 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,530 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,530 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,530 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,531 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,541 INFO [RS:0;jenkins-hbase6:35921] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:33,541 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,35921,1675796613230-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,542 INFO [RS:1;jenkins-hbase6:44919] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:33,542 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44919,1675796613257-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,552 INFO [RS:1;jenkins-hbase6:44919] regionserver.Replication(203): jenkins-hbase6.apache.org,44919,1675796613257 started 2023-02-07 19:03:33,552 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,44919,1675796613257, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44919, sessionid=0x1013e983a730002 2023-02-07 19:03:33,552 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:33,552 DEBUG [RS:1;jenkins-hbase6:44919] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,552 DEBUG [RS:1;jenkins-hbase6:44919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44919,1675796613257' 2023-02-07 19:03:33,552 DEBUG [RS:1;jenkins-hbase6:44919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:33,552 INFO [RS:0;jenkins-hbase6:35921] regionserver.Replication(203): jenkins-hbase6.apache.org,35921,1675796613230 started 2023-02-07 19:03:33,552 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,35921,1675796613230, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:35921, sessionid=0x1013e983a730001 2023-02-07 19:03:33,552 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,35921,1675796613230' 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44919,1675796613257' 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,35921,1675796613230' 2023-02-07 19:03:33,553 DEBUG [RS:0;jenkins-hbase6:35921] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:33,553 DEBUG [RS:1;jenkins-hbase6:44919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:33,554 DEBUG [RS:0;jenkins-hbase6:35921] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:33,554 DEBUG [RS:1;jenkins-hbase6:44919] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:33,554 INFO [RS:1;jenkins-hbase6:44919] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:33,554 INFO [RS:1;jenkins-hbase6:44919] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:33,554 DEBUG [RS:0;jenkins-hbase6:35921] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:33,554 INFO [RS:0;jenkins-hbase6:35921] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:33,554 INFO [RS:0;jenkins-hbase6:35921] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:33,585 DEBUG [jenkins-hbase6:34673] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:03:33,585 DEBUG [jenkins-hbase6:34673] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:33,586 DEBUG [jenkins-hbase6:34673] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:33,586 DEBUG [jenkins-hbase6:34673] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:33,586 DEBUG [jenkins-hbase6:34673] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:33,586 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44919,1675796613257, state=OPENING 2023-02-07 19:03:33,589 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:03:33,591 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:33,594 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:33,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44919,1675796613257}] 2023-02-07 19:03:33,747 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:33,747 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:33,749 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:33,752 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:03:33,752 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:33,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44919%2C1675796613257.meta, suffix=.meta, logDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,44919,1675796613257, archiveDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/oldWALs, maxLogs=32 2023-02-07 19:03:33,772 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK] 2023-02-07 19:03:33,772 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK] 2023-02-07 19:03:33,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,44919,1675796613257/jenkins-hbase6.apache.org%2C44919%2C1675796613257.meta.1675796613754.meta 2023-02-07 19:03:33,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK]] 2023-02-07 19:03:33,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:33,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:03:33,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:03:33,775 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:03:33,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:03:33,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:33,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:03:33,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:03:33,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:33,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/info 2023-02-07 19:03:33,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/info 2023-02-07 19:03:33,777 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:33,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:33,778 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:33,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:33,779 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:33,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:33,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/table 2023-02-07 19:03:33,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/table 2023-02-07 19:03:33,780 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:33,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:33,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740 2023-02-07 19:03:33,782 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740 2023-02-07 19:03:33,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:33,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:33,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63143562, jitterRate=-0.0590876042842865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:33,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796613775Writing region info on filesystem at 1675796613775Initializing all the Stores at 1675796613776 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796613776Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796613776Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796613776Cleaning up temporary data from old regions at 1675796613782 (+6 ms)Cleaning up detritus from prior splits at 1675796613783 (+1 ms)Running coprocessor post-open hooks at 1675796613785 (+2 ms)Region opened successfully at 1675796613785 2023-02-07 19:03:33,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796613747 2023-02-07 19:03:33,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:03:33,789 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:03:33,789 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44919,1675796613257, state=OPEN 2023-02-07 19:03:33,791 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:03:33,791 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:33,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:03:33,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44919,1675796613257 in 200 msec 2023-02-07 19:03:33,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:03:33,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-07 19:03:33,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 399 msec 2023-02-07 19:03:33,796 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796613279, completionTime=-1 2023-02-07 19:03:33,796 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:03:33,796 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:03:33,799 DEBUG [hconnection-0x32b3db9a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:33,800 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:33,801 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:03:33,801 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796673801 2023-02-07 19:03:33,801 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796733801 2023-02-07 19:03:33,801 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34673,1675796612671-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34673,1675796612671-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34673,1675796612671-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:34673, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:03:33,808 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:33,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:03:33,810 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:03:33,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:33,811 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:33,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:33,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c empty. 2023-02-07 19:03:33,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:33,813 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:03:33,825 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:33,826 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 97f060487d0c8f24ae77265ab6a45a3c, NAME => 'hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp 2023-02-07 19:03:33,836 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:33,836 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 97f060487d0c8f24ae77265ab6a45a3c, disabling compactions & flushes 2023-02-07 19:03:33,836 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:33,836 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:33,836 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. after waiting 0 ms 2023-02-07 19:03:33,836 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:33,836 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:33,837 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 97f060487d0c8f24ae77265ab6a45a3c: Waiting for close lock at 1675796613836Disabling compacts and flushes for region at 1675796613836Disabling writes for close at 1675796613836Writing region close event to WAL at 1675796613836Closed at 1675796613836 2023-02-07 19:03:33,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:33,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796613839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796613839"}]},"ts":"1675796613839"} 2023-02-07 19:03:33,841 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:33,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:33,842 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796613842"}]},"ts":"1675796613842"} 2023-02-07 19:03:33,843 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:03:33,846 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:33,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:33,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:33,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:33,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=97f060487d0c8f24ae77265ab6a45a3c, ASSIGN}] 2023-02-07 19:03:33,849 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=97f060487d0c8f24ae77265ab6a45a3c, ASSIGN 2023-02-07 19:03:33,850 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=97f060487d0c8f24ae77265ab6a45a3c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44919,1675796613257; forceNewPlan=false, retain=false 2023-02-07 19:03:34,000 INFO [jenkins-hbase6:34673] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:34,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=97f060487d0c8f24ae77265ab6a45a3c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:34,000 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796614000"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796614000"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796614000"}]},"ts":"1675796614000"} 2023-02-07 19:03:34,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 97f060487d0c8f24ae77265ab6a45a3c, server=jenkins-hbase6.apache.org,44919,1675796613257}] 2023-02-07 19:03:34,157 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:34,158 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44919%2C1675796613257, suffix=, logDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,44919,1675796613257, archiveDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/oldWALs, maxLogs=32 2023-02-07 19:03:34,170 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK] 2023-02-07 19:03:34,170 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK] 2023-02-07 19:03:34,172 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,44919,1675796613257/jenkins-hbase6.apache.org%2C44919%2C1675796613257.1675796614158 2023-02-07 19:03:34,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK]] 2023-02-07 19:03:34,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 97f060487d0c8f24ae77265ab6a45a3c, NAME => 'hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:34,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:34,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,173 INFO [StoreOpener-97f060487d0c8f24ae77265ab6a45a3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,174 DEBUG [StoreOpener-97f060487d0c8f24ae77265ab6a45a3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/info 2023-02-07 19:03:34,175 DEBUG [StoreOpener-97f060487d0c8f24ae77265ab6a45a3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/info 2023-02-07 19:03:34,175 INFO [StoreOpener-97f060487d0c8f24ae77265ab6a45a3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97f060487d0c8f24ae77265ab6a45a3c columnFamilyName info 2023-02-07 19:03:34,175 INFO [StoreOpener-97f060487d0c8f24ae77265ab6a45a3c-1] regionserver.HStore(310): Store=97f060487d0c8f24ae77265ab6a45a3c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:34,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:34,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:34,180 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 97f060487d0c8f24ae77265ab6a45a3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64526022, jitterRate=-0.03848734498023987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:34,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 97f060487d0c8f24ae77265ab6a45a3c: Running coprocessor pre-open hook at 1675796614173Writing region info on filesystem at 1675796614173Initializing all the Stores at 1675796614173Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796614173Cleaning up temporary data from old regions at 1675796614176 (+3 ms)Cleaning up detritus from prior splits at 1675796614177 (+1 ms)Running coprocessor post-open hooks at 1675796614180 (+3 ms)Region opened successfully at 1675796614180 2023-02-07 19:03:34,180 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c., pid=6, masterSystemTime=1675796614154 2023-02-07 19:03:34,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:34,183 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:34,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=97f060487d0c8f24ae77265ab6a45a3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:34,183 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796614183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796614183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796614183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796614183"}]},"ts":"1675796614183"} 2023-02-07 19:03:34,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:03:34,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 97f060487d0c8f24ae77265ab6a45a3c, server=jenkins-hbase6.apache.org,44919,1675796613257 in 182 msec 2023-02-07 19:03:34,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:03:34,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=97f060487d0c8f24ae77265ab6a45a3c, ASSIGN in 338 msec 2023-02-07 19:03:34,187 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:34,187 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796614187"}]},"ts":"1675796614187"} 2023-02-07 19:03:34,188 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:03:34,190 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:34,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-07 19:03:34,210 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:03:34,212 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:34,212 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:34,215 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:03:34,222 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:34,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-07 19:03:34,227 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:03:34,233 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:34,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-07 19:03:34,242 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:03:34,246 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:03:34,246 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.961sec 2023-02-07 19:03:34,246 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:03:34,246 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:03:34,246 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:03:34,246 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34673,1675796612671-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:03:34,246 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34673,1675796612671-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:03:34,247 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:03:34,277 DEBUG [Listener at localhost/39203] zookeeper.ReadOnlyZKClient(139): Connect 0x7dac2ad4 to 127.0.0.1:51148 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:34,286 DEBUG [Listener at localhost/39203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60f7f7b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:34,287 DEBUG [hconnection-0x62163513-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:34,289 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51048, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:34,290 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:34,290 DEBUG [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:03:34,290 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,290 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,292 DEBUG [Listener at localhost/39203] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:03:34,293 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:03:34,294 INFO [Listener at localhost/39203] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-07 19:03:34,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceSingleRegion 2023-02-07 19:03:34,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:03:34,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.2.20:36934 deadline: 1675796674294, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-07 19:03:34,295 INFO [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-07 19:03:34,296 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,296 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:34,297 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:34,299 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:34,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-07 19:03:34,300 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,300 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:34,300 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:34,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:34,301 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,302 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f empty. 2023-02-07 19:03:34,302 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-07 19:03:34,310 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:34,311 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 67657fe6501c4013e489ad0508b6f97f, NAME => 'testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp 2023-02-07 19:03:34,316 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:34,317 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 67657fe6501c4013e489ad0508b6f97f, disabling compactions & flushes 2023-02-07 19:03:34,317 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,317 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,317 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. after waiting 0 ms 2023-02-07 19:03:34,317 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,317 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,317 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 67657fe6501c4013e489ad0508b6f97f: Waiting for close lock at 1675796614317Disabling compacts and flushes for region at 1675796614317Disabling writes for close at 1675796614317Writing region close event to WAL at 1675796614317Closed at 1675796614317 2023-02-07 19:03:34,319 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:34,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675796614319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796614319"}]},"ts":"1675796614319"} 2023-02-07 19:03:34,321 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:34,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:34,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796614321"}]},"ts":"1675796614321"} 2023-02-07 19:03:34,322 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-07 19:03:34,326 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:34,326 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:34,326 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:34,327 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:34,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, ASSIGN}] 2023-02-07 19:03:34,328 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, ASSIGN 2023-02-07 19:03:34,329 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,35921,1675796613230; forceNewPlan=false, retain=false 2023-02-07 19:03:34,401 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,401 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:34,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:34,479 INFO [jenkins-hbase6:34673] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:34,479 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=67657fe6501c4013e489ad0508b6f97f, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:34,480 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675796614479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796614479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796614479"}]},"ts":"1675796614479"} 2023-02-07 19:03:34,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 67657fe6501c4013e489ad0508b6f97f, server=jenkins-hbase6.apache.org,35921,1675796613230}] 2023-02-07 19:03:34,555 INFO [RS:0;jenkins-hbase6:35921] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C35921%2C1675796613230, suffix=, logDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,35921,1675796613230, archiveDir=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/oldWALs, maxLogs=32 2023-02-07 19:03:34,570 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK] 2023-02-07 19:03:34,570 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK] 2023-02-07 19:03:34,572 INFO [RS:0;jenkins-hbase6:35921] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/WALs/jenkins-hbase6.apache.org,35921,1675796613230/jenkins-hbase6.apache.org%2C35921%2C1675796613230.1675796614556 2023-02-07 19:03:34,572 DEBUG [RS:0;jenkins-hbase6:35921] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35531,DS-81c29e73-6ea3-4472-8f0c-488d52539dc3,DISK], DatanodeInfoWithStorage[127.0.0.1:46113,DS-f248dc68-2867-4570-a8d3-ddcb16baa1a3,DISK]] 2023-02-07 19:03:34,603 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,603 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:34,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:34,634 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:34,634 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:34,636 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:54670, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:34,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 67657fe6501c4013e489ad0508b6f97f, NAME => 'testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:34,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:34,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,640 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,641 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1 2023-02-07 19:03:34,641 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1 2023-02-07 19:03:34,641 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67657fe6501c4013e489ad0508b6f97f columnFamilyName f1 2023-02-07 19:03:34,642 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(310): Store=67657fe6501c4013e489ad0508b6f97f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:34,642 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,643 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2 2023-02-07 19:03:34,643 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2 2023-02-07 19:03:34,643 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67657fe6501c4013e489ad0508b6f97f columnFamilyName f2 2023-02-07 19:03:34,643 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(310): Store=67657fe6501c4013e489ad0508b6f97f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:34,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:34,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:34,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:34,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 67657fe6501c4013e489ad0508b6f97f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63103594, jitterRate=-0.0596831738948822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:34,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 67657fe6501c4013e489ad0508b6f97f: Running coprocessor pre-open hook at 1675796614639Writing region info on filesystem at 1675796614639Initializing all the Stores at 1675796614640 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796614640Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796614640Cleaning up temporary data from old regions at 1675796614645 (+5 ms)Cleaning up detritus from prior splits at 1675796614645Running coprocessor post-open hooks at 1675796614648 (+3 ms)Region opened successfully at 1675796614648 2023-02-07 19:03:34,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f., pid=12, masterSystemTime=1675796614634 2023-02-07 19:03:34,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:34,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=67657fe6501c4013e489ad0508b6f97f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:34,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675796614655"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796614655"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796614655"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796614655"}]},"ts":"1675796614655"} 2023-02-07 19:03:34,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 19:03:34,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 67657fe6501c4013e489ad0508b6f97f, server=jenkins-hbase6.apache.org,35921,1675796613230 in 175 msec 2023-02-07 19:03:34,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 19:03:34,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, ASSIGN in 331 msec 2023-02-07 19:03:34,660 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:34,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796614660"}]},"ts":"1675796614660"} 2023-02-07 19:03:34,661 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-07 19:03:34,664 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:34,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 367 msec 2023-02-07 19:03:34,904 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:34,904 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:34,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:34,906 INFO [Listener at localhost/39203] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-07 19:03:34,906 DEBUG [Listener at localhost/39203] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-07 19:03:34,906 INFO [Listener at localhost/39203] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:34,908 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-07 19:03:34,908 INFO [Listener at localhost/39203] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:34,908 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-07 19:03:34,908 INFO [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:03:34,922 DEBUG [hconnection-0x62163513-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:34,934 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:54674, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:34,941 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,020 INFO [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:03:35,020 INFO [Listener at localhost/39203] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:03:35,020 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,020 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 19:03:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796615021 (current time:1675796615021). 2023-02-07 19:03:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:03:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] zookeeper.ReadOnlyZKClient(139): Connect 0x60837b52 to 127.0.0.1:51148 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26d0abf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:35,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:35,027 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:35,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60837b52 to 127.0.0.1:51148 2023-02-07 19:03:35,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:35,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:03:35,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 19:03:35,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 19:03:35,031 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 19:03:35,032 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675797215032 2023-02-07 19:03:35,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 19:03:35,032 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,033 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:35,034 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 19:03:35,034 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:03:35,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 19:03:35,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-07 19:03:35,036 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 19:03:35,036 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675797215036 2023-02-07 19:03:35,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,043 INFO [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-07 19:03:35,043 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:35,044 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-07 19:03:35,044 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 19:03:35,045 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,045 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,047 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:35,047 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:35,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:35,047 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:35,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:35,047 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,047 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,048 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-07 19:03:35,048 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:35,048 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-07 19:03:35,049 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 19:03:35,049 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 19:03:35,049 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:35,049 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,35921,1675796613230' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 19:03:35,050 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 19:03:35,050 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 19:03:35,050 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44919,1675796613257' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 19:03:35,052 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,052 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:35,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:35,054 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,054 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,054 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:35,054 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,054 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:35,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,35921,1675796613230' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-07 19:03:35,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50ec5b44[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:35,055 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 19:03:35,055 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,057 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,058 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:35,057 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 19:03:35,057 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 19:03:35,058 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 19:03:35,058 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,44919,1675796613257' in zk 2023-02-07 19:03:35,058 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 19:03:35,058 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:35,058 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,058 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. started... 2023-02-07 19:03:35,058 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 67657fe6501c4013e489ad0508b6f97f 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 19:03:35,060 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 19:03:35,060 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:35,060 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 19:03:35,077 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f1/c4c67b2e316442a7b9248a6b8c20d411 2023-02-07 19:03:35,093 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f2/431bf5a834234e5aaf8e1c66c417c4a5 2023-02-07 19:03:35,097 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f1/c4c67b2e316442a7b9248a6b8c20d411 as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/c4c67b2e316442a7b9248a6b8c20d411 2023-02-07 19:03:35,100 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/c4c67b2e316442a7b9248a6b8c20d411, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:35,101 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f2/431bf5a834234e5aaf8e1c66c417c4a5 as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/431bf5a834234e5aaf8e1c66c417c4a5 2023-02-07 19:03:35,104 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/431bf5a834234e5aaf8e1c66c417c4a5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:35,105 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 67657fe6501c4013e489ad0508b6f97f in 47ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:35,105 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 67657fe6501c4013e489ad0508b6f97f: 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/c4c67b2e316442a7b9248a6b8c20d411] hfiles 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/c4c67b2e316442a7b9248a6b8c20d411 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/431bf5a834234e5aaf8e1c66c417c4a5] hfiles 2023-02-07 19:03:35,106 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/431bf5a834234e5aaf8e1c66c417c4a5 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,112 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. completed. 2023-02-07 19:03:35,112 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,112 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 19:03:35,112 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 19:03:35,112 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,112 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 19:03:35,112 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,35921,1675796613230' in zk 2023-02-07 19:03:35,116 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,117 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 19:03:35,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:35,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:35,117 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:35,117 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 19:03:35,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:35,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:35,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase6.apache.org,35921,1675796613230': 2023-02-07 19:03:35,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,35921,1675796613230' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:35,119 INFO [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-07 19:03:35,119 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:35,119 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:35,119 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,119 INFO [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:35,122 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:35,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:35,122 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,122 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:35,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:35,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:35,122 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,123 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,124 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:35,124 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:35,131 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:35,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:35,131 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,132 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:35,132 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:35,132 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,132 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:35,134 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:35,135 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,135 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-07 19:03:35,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:35,136 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:03:35,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-07 19:03:35,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,159 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675796615032Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675796615131 (+99 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675796615131Writing data manifest for testWithMockedMapReduceSingleRegion at 1675796615134 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675796615139 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675796615158 (+19 ms) 2023-02-07 19:03:35,160 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 19:03:35,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 127 msec 2023-02-07 19:03:35,336 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:35,336 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,336 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-07 19:03:35,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:35,338 INFO [Listener at localhost/39203] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:35,338 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,338 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,344 INFO [Listener at localhost/39203] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:35,349 INFO [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:35,378 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,461 INFO [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:35,464 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,464 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:35,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,468 INFO [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-07 19:03:35,468 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:35,469 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-07 19:03:35,469 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 19:03:35,469 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,469 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,471 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:35,471 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:35,471 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,471 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,471 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,474 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-07 19:03:35,474 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-07 19:03:35,474 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:35,474 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:35,475 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 19:03:35,476 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 19:03:35,476 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 19:03:35,476 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44919,1675796613257' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 19:03:35,476 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 19:03:35,476 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:35,476 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,476 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. started... 2023-02-07 19:03:35,476 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 67657fe6501c4013e489ad0508b6f97f 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 19:03:35,477 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,478 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,478 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:35,491 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f1/03b5c47c846645d19bb0b92aa88f224f 2023-02-07 19:03:35,508 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f2/5aead203c2fb499f9481ba90c80e51c5 2023-02-07 19:03:35,513 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f1/03b5c47c846645d19bb0b92aa88f224f as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/03b5c47c846645d19bb0b92aa88f224f 2023-02-07 19:03:35,516 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/03b5c47c846645d19bb0b92aa88f224f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:35,517 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/.tmp/f2/5aead203c2fb499f9481ba90c80e51c5 as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/5aead203c2fb499f9481ba90c80e51c5 2023-02-07 19:03:35,521 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/5aead203c2fb499f9481ba90c80e51c5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:35,521 INFO [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 67657fe6501c4013e489ad0508b6f97f in 45ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:35,522 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 67657fe6501c4013e489ad0508b6f97f: 2023-02-07 19:03:35,523 DEBUG [rs(jenkins-hbase6.apache.org,35921,1675796613230)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,523 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 19:03:35,523 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 19:03:35,523 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,523 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 19:03:35,523 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,35921,1675796613230' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 19:03:35,525 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,525 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:35,525 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,525 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:35,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:35,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,35921,1675796613230' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-07 19:03:35,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54d3d581[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:35,527 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 19:03:35,527 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,529 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 19:03:35,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,529 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 19:03:35,529 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 19:03:35,529 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:35,529 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 19:03:35,529 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,35921,1675796613230' in zk 2023-02-07 19:03:35,529 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,44919,1675796613257' in zk 2023-02-07 19:03:35,532 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,532 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 19:03:35,532 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:35,532 DEBUG [member: 'jenkins-hbase6.apache.org,35921,1675796613230' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 19:03:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:35,532 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 19:03:35,532 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:35,532 DEBUG [member: 'jenkins-hbase6.apache.org,44919,1675796613257' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 19:03:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase6.apache.org,35921,1675796613230': 2023-02-07 19:03:35,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,35921,1675796613230' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:35,535 INFO [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-07 19:03:35,535 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:35,535 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:35,535 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,535 INFO [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:35,536 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,536 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,536 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:35,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,536 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,536 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:35,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:35,537 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:35,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,537 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,539 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,539 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,541 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:35,541 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:35,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:35,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-07 19:03:35,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:35,542 DEBUG [(jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:35,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:35,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:35,542 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,543 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:35,543 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,543 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,543 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,543 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,642 DEBUG [Listener at localhost/39203] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:35,643 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,643 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:35,648 INFO [Listener at localhost/39203] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675796615021 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:35,648 DEBUG [Listener at localhost/39203] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09/data/default/testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,648 INFO [Listener at localhost/39203] snapshot.RestoreSnapshotHelper(239): region to add: 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:35,648 INFO [Listener at localhost/39203] snapshot.RestoreSnapshotHelper(585): clone region=67657fe6501c4013e489ad0508b6f97f as 67657fe6501c4013e489ad0508b6f97f in snapshot testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,649 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 67657fe6501c4013e489ad0508b6f97f, NAME => 'testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09 2023-02-07 19:03:35,655 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:35,655 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c4c67b2e316442a7b9248a6b8c20d411 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,657 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 431bf5a834234e5aaf8e1c66c417c4a5 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,659 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 67657fe6501c4013e489ad0508b6f97f, disabling compactions & flushes 2023-02-07 19:03:35,659 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,659 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,659 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. after waiting 0 ms 2023-02-07 19:03:35,659 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,659 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,659 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 67657fe6501c4013e489ad0508b6f97f: Waiting for close lock at 1675796615659Disabling compacts and flushes for region at 1675796615659Disabling writes for close at 1675796615659Writing region close event to WAL at 1675796615659Closed at 1675796615659 2023-02-07 19:03:35,659 INFO [Listener at localhost/39203] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675796615021 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:35,659 DEBUG [Listener at localhost/39203] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09 2023-02-07 19:03:35,659 DEBUG [Listener at localhost/39203] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09 2023-02-07 19:03:35,660 DEBUG [Listener at localhost/39203] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:35,660 DEBUG [Listener at localhost/39203] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:35,660 DEBUG [Listener at localhost/39203] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-07 19:03:35,661 DEBUG [Listener at localhost/39203] util.CommonFSUtils(699): |----------67657fe6501c4013e489ad0508b6f97f/ 2023-02-07 19:03:35,661 DEBUG [Listener at localhost/39203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:35,661 DEBUG [Listener at localhost/39203] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:35,661 DEBUG [Listener at localhost/39203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=67657fe6501c4013e489ad0508b6f97f-c4c67b2e316442a7b9248a6b8c20d411 2023-02-07 19:03:35,661 DEBUG [Listener at localhost/39203] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:35,661 DEBUG [Listener at localhost/39203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=67657fe6501c4013e489ad0508b6f97f-431bf5a834234e5aaf8e1c66c417c4a5 2023-02-07 19:03:35,664 INFO [Listener at localhost/39203] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 19:03:35,667 DEBUG [Listener at localhost/39203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:35,667 INFO [Listener at localhost/39203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:35,668 DEBUG [Listener at localhost/39203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:35,670 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:35,671 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1 2023-02-07 19:03:35,671 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67657fe6501c4013e489ad0508b6f97f columnFamilyName f1 2023-02-07 19:03:35,674 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(539): loaded hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/testWithMockedMapReduceSingleRegion=67657fe6501c4013e489ad0508b6f97f-c4c67b2e316442a7b9248a6b8c20d411 2023-02-07 19:03:35,674 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(310): Store=67657fe6501c4013e489ad0508b6f97f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:35,675 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:35,675 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2 2023-02-07 19:03:35,675 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67657fe6501c4013e489ad0508b6f97f columnFamilyName f2 2023-02-07 19:03:35,678 DEBUG [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(539): loaded hdfs://localhost:44947/user/jenkins/test-data/43054539-de86-63b2-bf92-4708b0dd4138/testWithMockedMapReduceSingleRegion/5f4ca92d-9924-4bde-a71b-252da6546d09/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/testWithMockedMapReduceSingleRegion=67657fe6501c4013e489ad0508b6f97f-431bf5a834234e5aaf8e1c66c417c4a5 2023-02-07 19:03:35,679 INFO [StoreOpener-67657fe6501c4013e489ad0508b6f97f-1] regionserver.HStore(310): Store=67657fe6501c4013e489ad0508b6f97f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:35,679 DEBUG [Listener at localhost/39203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:35,679 INFO [Listener at localhost/39203] regionserver.HRegion(1071): Opened 67657fe6501c4013e489ad0508b6f97f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73572954, jitterRate=0.0963224470615387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:35,679 DEBUG [Listener at localhost/39203] regionserver.HRegion(964): Region open journal for 67657fe6501c4013e489ad0508b6f97f: Writing region info on filesystem at 1675796615668Initializing all the Stores at 1675796615669 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796615669Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796615669Region opened successfully at 1675796615679 (+10 ms) 2023-02-07 19:03:35,736 DEBUG [Listener at localhost/39203] regionserver.HRegion(1603): Closing 67657fe6501c4013e489ad0508b6f97f, disabling compactions & flushes 2023-02-07 19:03:35,736 INFO [Listener at localhost/39203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,737 DEBUG [Listener at localhost/39203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,737 DEBUG [Listener at localhost/39203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. after waiting 0 ms 2023-02-07 19:03:35,737 DEBUG [Listener at localhost/39203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,737 INFO [Listener at localhost/39203] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,738 DEBUG [Listener at localhost/39203] regionserver.HRegion(1557): Region close journal for 67657fe6501c4013e489ad0508b6f97f: Waiting for close lock at 1675796615736Disabling compacts and flushes for region at 1675796615736Disabling writes for close at 1675796615737 (+1 ms)Writing region close event to WAL at 1675796615737Closed at 1675796615737 2023-02-07 19:03:35,741 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,741 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-07 19:03:35,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,745 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,746 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,746 INFO [Listener at localhost/39203] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:35,749 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,749 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,750 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796615750"}]},"ts":"1675796615750"} 2023-02-07 19:03:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:35,751 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-07 19:03:35,754 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-07 19:03:35,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, UNASSIGN}] 2023-02-07 19:03:35,755 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, UNASSIGN 2023-02-07 19:03:35,756 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=67657fe6501c4013e489ad0508b6f97f, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:35,756 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675796615756"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796615756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796615756"}]},"ts":"1675796615756"} 2023-02-07 19:03:35,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 67657fe6501c4013e489ad0508b6f97f, server=jenkins-hbase6.apache.org,35921,1675796613230}] 2023-02-07 19:03:35,850 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:35,850 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:35,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:35,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:35,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 67657fe6501c4013e489ad0508b6f97f, disabling compactions & flushes 2023-02-07 19:03:35,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. after waiting 0 ms 2023-02-07 19:03:35,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:35,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f. 2023-02-07 19:03:35,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 67657fe6501c4013e489ad0508b6f97f: Waiting for close lock at 1675796615909Running coprocessor pre-close hooks at 1675796615909Disabling compacts and flushes for region at 1675796615909Disabling writes for close at 1675796615909Writing region close event to WAL at 1675796615910 (+1 ms)Running coprocessor post-close hooks at 1675796615913 (+3 ms)Closed at 1675796615913 2023-02-07 19:03:35,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:35,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=67657fe6501c4013e489ad0508b6f97f, regionState=CLOSED 2023-02-07 19:03:35,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675796615915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796615915"}]},"ts":"1675796615915"} 2023-02-07 19:03:35,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 19:03:35,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 67657fe6501c4013e489ad0508b6f97f, server=jenkins-hbase6.apache.org,35921,1675796613230 in 160 msec 2023-02-07 19:03:35,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 19:03:35,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=67657fe6501c4013e489ad0508b6f97f, UNASSIGN in 164 msec 2023-02-07 19:03:35,920 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796615919"}]},"ts":"1675796615919"} 2023-02-07 19:03:35,920 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-07 19:03:35,922 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-07 19:03:35,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-07 19:03:36,052 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:36,052 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:36,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:36,054 INFO [Listener at localhost/39203] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-07 19:03:36,054 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:36,054 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:36,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,057 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,057 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:36,057 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:36,058 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:36,060 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:36,062 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1, FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2, FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/recovered.edits] 2023-02-07 19:03:36,065 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/03b5c47c846645d19bb0b92aa88f224f to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/archive/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/03b5c47c846645d19bb0b92aa88f224f 2023-02-07 19:03:36,066 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/c4c67b2e316442a7b9248a6b8c20d411 to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/archive/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f1/c4c67b2e316442a7b9248a6b8c20d411 2023-02-07 19:03:36,068 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/431bf5a834234e5aaf8e1c66c417c4a5 to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/archive/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/431bf5a834234e5aaf8e1c66c417c4a5 2023-02-07 19:03:36,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/5aead203c2fb499f9481ba90c80e51c5 to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/archive/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/f2/5aead203c2fb499f9481ba90c80e51c5 2023-02-07 19:03:36,071 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/recovered.edits/12.seqid to hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/archive/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f/recovered.edits/12.seqid 2023-02-07 19:03:36,072 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/.tmp/data/default/testWithMockedMapReduceSingleRegion/67657fe6501c4013e489ad0508b6f97f 2023-02-07 19:03:36,072 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-07 19:03:36,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,075 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-07 19:03:36,077 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-07 19:03:36,077 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,077 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-07 19:03:36,077 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796616077"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:36,078 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 19:03:36,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 67657fe6501c4013e489ad0508b6f97f, NAME => 'testWithMockedMapReduceSingleRegion,,1675796614297.67657fe6501c4013e489ad0508b6f97f.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 19:03:36,079 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-07 19:03:36,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675796616079"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:36,080 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-07 19:03:36,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 19:03:36,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-07 19:03:36,159 INFO [Listener at localhost/39203] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:36,159 INFO [Listener at localhost/39203] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:36,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34673] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:36,160 INFO [Listener at localhost/39203] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-07 19:03:36,161 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:36,161 INFO [Listener at localhost/39203] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:36,161 DEBUG [Listener at localhost/39203] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dac2ad4 to 127.0.0.1:51148 2023-02-07 19:03:36,161 DEBUG [Listener at localhost/39203] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,161 DEBUG [Listener at localhost/39203] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:36,161 DEBUG [Listener at localhost/39203] util.JVMClusterUtil(257): Found active master hash=419796347, stopped=false 2023-02-07 19:03:36,161 INFO [Listener at localhost/39203] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:36,164 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:36,164 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:36,164 INFO [Listener at localhost/39203] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:36,164 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:36,164 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:36,166 DEBUG [Listener at localhost/39203] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6066d5bd to 127.0.0.1:51148 2023-02-07 19:03:36,166 DEBUG [Listener at localhost/39203] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,166 INFO [Listener at localhost/39203] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,35921,1675796613230' ***** 2023-02-07 19:03:36,166 INFO [Listener at localhost/39203] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:36,166 INFO [Listener at localhost/39203] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44919,1675796613257' ***** 2023-02-07 19:03:36,166 INFO [Listener at localhost/39203] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:36,166 INFO [RS:0;jenkins-hbase6:35921] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:36,167 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:36,167 INFO [RS:0;jenkins-hbase6:35921] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:36,168 INFO [RS:0;jenkins-hbase6:35921] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:36,168 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:36,168 DEBUG [RS:0;jenkins-hbase6:35921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1909672d to 127.0.0.1:51148 2023-02-07 19:03:36,168 DEBUG [RS:0;jenkins-hbase6:35921] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,168 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,35921,1675796613230; all regions closed. 2023-02-07 19:03:36,170 INFO [RS:1;jenkins-hbase6:44919] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:36,170 INFO [RS:1;jenkins-hbase6:44919] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:36,170 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:36,170 INFO [RS:1;jenkins-hbase6:44919] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(3304): Received CLOSE for 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:36,171 DEBUG [RS:1;jenkins-hbase6:44919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4684dd9c to 127.0.0.1:51148 2023-02-07 19:03:36,171 DEBUG [RS:1;jenkins-hbase6:44919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 97f060487d0c8f24ae77265ab6a45a3c, disabling compactions & flushes 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:36,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:36,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:36,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. after waiting 0 ms 2023-02-07 19:03:36,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:36,171 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-07 19:03:36,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 97f060487d0c8f24ae77265ab6a45a3c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:36,171 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 97f060487d0c8f24ae77265ab6a45a3c=hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c.} 2023-02-07 19:03:36,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:36,172 DEBUG [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1505): Waiting on 1588230740, 97f060487d0c8f24ae77265ab6a45a3c 2023-02-07 19:03:36,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:36,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:36,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:36,172 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:36,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-07 19:03:36,173 DEBUG [RS:0;jenkins-hbase6:35921] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/oldWALs 2023-02-07 19:03:36,173 INFO [RS:0;jenkins-hbase6:35921] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C35921%2C1675796613230:(num 1675796614556) 2023-02-07 19:03:36,173 DEBUG [RS:0;jenkins-hbase6:35921] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,173 INFO [RS:0;jenkins-hbase6:35921] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:36,173 INFO [RS:0;jenkins-hbase6:35921] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:36,173 INFO [RS:0;jenkins-hbase6:35921] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:36,173 INFO [RS:0;jenkins-hbase6:35921] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:36,173 INFO [RS:0;jenkins-hbase6:35921] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:36,173 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:36,174 INFO [RS:0;jenkins-hbase6:35921] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:35921 2023-02-07 19:03:36,179 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:36,179 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:36,179 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,35921,1675796613230 2023-02-07 19:03:36,179 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6ae28e7f rejected from java.util.concurrent.ThreadPoolExecutor@6edd07fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,179 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:36,179 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:36,179 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6451f480 rejected from java.util.concurrent.ThreadPoolExecutor@6edd07fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,181 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,35921,1675796613230] 2023-02-07 19:03:36,181 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,35921,1675796613230; numProcessing=1 2023-02-07 19:03:36,182 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,35921,1675796613230 already deleted, retry=false 2023-02-07 19:03:36,182 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,35921,1675796613230 expired; onlineServers=1 2023-02-07 19:03:36,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/.tmp/info/88486db2d15d41be8245d0f83692d27a 2023-02-07 19:03:36,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/.tmp/info/5f96beccb59a4962908b075b4213118c 2023-02-07 19:03:36,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88486db2d15d41be8245d0f83692d27a 2023-02-07 19:03:36,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/.tmp/info/5f96beccb59a4962908b075b4213118c as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/info/5f96beccb59a4962908b075b4213118c 2023-02-07 19:03:36,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/info/5f96beccb59a4962908b075b4213118c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:36,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 97f060487d0c8f24ae77265ab6a45a3c in 24ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:36,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/.tmp/rep_barrier/36d046ef60934a7bbb281b4e23628369 2023-02-07 19:03:36,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/namespace/97f060487d0c8f24ae77265ab6a45a3c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:36,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36d046ef60934a7bbb281b4e23628369 2023-02-07 19:03:36,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:36,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 97f060487d0c8f24ae77265ab6a45a3c: Waiting for close lock at 1675796616171Running coprocessor pre-close hooks at 1675796616171Disabling compacts and flushes for region at 1675796616171Disabling writes for close at 1675796616171Obtaining lock to block concurrent updates at 1675796616172 (+1 ms)Preparing flush snapshotting stores in 97f060487d0c8f24ae77265ab6a45a3c at 1675796616172Finished memstore snapshotting hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796616172Flushing stores of hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. at 1675796616172Flushing 97f060487d0c8f24ae77265ab6a45a3c/info: creating writer at 1675796616172Flushing 97f060487d0c8f24ae77265ab6a45a3c/info: appending metadata at 1675796616177 (+5 ms)Flushing 97f060487d0c8f24ae77265ab6a45a3c/info: closing flushed file at 1675796616177Flushing 97f060487d0c8f24ae77265ab6a45a3c/info: reopening flushed file at 1675796616191 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 97f060487d0c8f24ae77265ab6a45a3c in 24ms, sequenceid=6, compaction requested=false at 1675796616195 (+4 ms)Writing region close event to WAL at 1675796616195Running coprocessor post-close hooks at 1675796616201 (+6 ms)Closed at 1675796616201 2023-02-07 19:03:36,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796613808.97f060487d0c8f24ae77265ab6a45a3c. 2023-02-07 19:03:36,209 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/.tmp/table/1c69c4fbe9ef481d9baf0d843aca59ca 2023-02-07 19:03:36,212 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c69c4fbe9ef481d9baf0d843aca59ca 2023-02-07 19:03:36,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/.tmp/info/88486db2d15d41be8245d0f83692d27a as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/info/88486db2d15d41be8245d0f83692d27a 2023-02-07 19:03:36,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88486db2d15d41be8245d0f83692d27a 2023-02-07 19:03:36,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/info/88486db2d15d41be8245d0f83692d27a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 19:03:36,217 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/.tmp/rep_barrier/36d046ef60934a7bbb281b4e23628369 as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/rep_barrier/36d046ef60934a7bbb281b4e23628369 2023-02-07 19:03:36,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36d046ef60934a7bbb281b4e23628369 2023-02-07 19:03:36,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/rep_barrier/36d046ef60934a7bbb281b4e23628369, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 19:03:36,221 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/.tmp/table/1c69c4fbe9ef481d9baf0d843aca59ca as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/table/1c69c4fbe9ef481d9baf0d843aca59ca 2023-02-07 19:03:36,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c69c4fbe9ef481d9baf0d843aca59ca 2023-02-07 19:03:36,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/table/1c69c4fbe9ef481d9baf0d843aca59ca, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 19:03:36,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false 2023-02-07 19:03:36,231 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 19:03:36,231 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:36,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:36,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796616172Running coprocessor pre-close hooks at 1675796616172Disabling compacts and flushes for region at 1675796616172Disabling writes for close at 1675796616172Obtaining lock to block concurrent updates at 1675796616172Preparing flush snapshotting stores in 1588230740 at 1675796616172Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675796616172Flushing stores of hbase:meta,,1.1588230740 at 1675796616172Flushing 1588230740/info: creating writer at 1675796616172Flushing 1588230740/info: appending metadata at 1675796616177 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675796616177Flushing 1588230740/rep_barrier: creating writer at 1675796616190 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675796616192 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675796616192Flushing 1588230740/table: creating writer at 1675796616201 (+9 ms)Flushing 1588230740/table: appending metadata at 1675796616203 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796616203Flushing 1588230740/info: reopening flushed file at 1675796616213 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675796616217 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675796616222 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false at 1675796616228 (+6 ms)Writing region close event to WAL at 1675796616229 (+1 ms)Running coprocessor post-close hooks at 1675796616231 (+2 ms)Closed at 1675796616232 (+1 ms) 2023-02-07 19:03:36,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:36,234 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:36,235 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:36,363 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:36,363 INFO [RS:0;jenkins-hbase6:35921] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,35921,1675796613230; zookeeper connection closed. 2023-02-07 19:03:36,363 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cda2170 rejected from java.util.concurrent.ThreadPoolExecutor@6edd07fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,363 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64c72872] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64c72872 2023-02-07 19:03:36,363 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1013e983a730001, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:36,364 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@206e6301 rejected from java.util.concurrent.ThreadPoolExecutor@6edd07fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,372 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44919,1675796613257; all regions closed. 2023-02-07 19:03:36,375 DEBUG [RS:1;jenkins-hbase6:44919] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/oldWALs 2023-02-07 19:03:36,375 INFO [RS:1;jenkins-hbase6:44919] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44919%2C1675796613257.meta:.meta(num 1675796613754) 2023-02-07 19:03:36,379 DEBUG [RS:1;jenkins-hbase6:44919] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/oldWALs 2023-02-07 19:03:36,379 INFO [RS:1;jenkins-hbase6:44919] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44919%2C1675796613257:(num 1675796614158) 2023-02-07 19:03:36,379 DEBUG [RS:1;jenkins-hbase6:44919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,379 INFO [RS:1;jenkins-hbase6:44919] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:36,379 INFO [RS:1;jenkins-hbase6:44919] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:36,379 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:36,380 INFO [RS:1;jenkins-hbase6:44919] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44919 2023-02-07 19:03:36,381 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44919,1675796613257 2023-02-07 19:03:36,381 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:36,381 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3de1c368 rejected from java.util.concurrent.ThreadPoolExecutor@39de400c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,384 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44919,1675796613257] 2023-02-07 19:03:36,384 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44919,1675796613257; numProcessing=2 2023-02-07 19:03:36,385 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44919,1675796613257 already deleted, retry=false 2023-02-07 19:03:36,385 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44919,1675796613257 expired; onlineServers=0 2023-02-07 19:03:36,385 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,34673,1675796612671' ***** 2023-02-07 19:03:36,385 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:36,386 DEBUG [M:0;jenkins-hbase6:34673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d3a0283, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:36,386 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,34673,1675796612671 2023-02-07 19:03:36,386 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,34673,1675796612671; all regions closed. 2023-02-07 19:03:36,386 DEBUG [M:0;jenkins-hbase6:34673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:36,386 DEBUG [M:0;jenkins-hbase6:34673] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:36,386 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:36,386 DEBUG [M:0;jenkins-hbase6:34673] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:36,386 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796613401] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796613401,5,FailOnTimeoutGroup] 2023-02-07 19:03:36,386 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796613401] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796613401,5,FailOnTimeoutGroup] 2023-02-07 19:03:36,387 INFO [M:0;jenkins-hbase6:34673] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:36,388 INFO [M:0;jenkins-hbase6:34673] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:36,388 INFO [M:0;jenkins-hbase6:34673] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:36,388 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:36,388 DEBUG [M:0;jenkins-hbase6:34673] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:36,388 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:36,388 INFO [M:0;jenkins-hbase6:34673] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:36,389 ERROR [M:0;jenkins-hbase6:34673] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 19:03:36,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:36,389 INFO [M:0;jenkins-hbase6:34673] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:36,389 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:36,389 DEBUG [M:0;jenkins-hbase6:34673] zookeeper.ZKUtil(398): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:36,389 WARN [M:0;jenkins-hbase6:34673] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:36,390 INFO [M:0;jenkins-hbase6:34673] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:36,390 INFO [M:0;jenkins-hbase6:34673] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:36,390 DEBUG [M:0;jenkins-hbase6:34673] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:36,390 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:36,390 DEBUG [M:0;jenkins-hbase6:34673] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:36,390 DEBUG [M:0;jenkins-hbase6:34673] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:36,390 DEBUG [M:0;jenkins-hbase6:34673] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:36,390 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.15 KB heapSize=67.07 KB 2023-02-07 19:03:36,405 INFO [M:0;jenkins-hbase6:34673] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.15 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2ceb963800ee4907ac190963d644a42e 2023-02-07 19:03:36,411 DEBUG [M:0;jenkins-hbase6:34673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2ceb963800ee4907ac190963d644a42e as hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2ceb963800ee4907ac190963d644a42e 2023-02-07 19:03:36,415 INFO [M:0;jenkins-hbase6:34673] regionserver.HStore(1080): Added hdfs://localhost:44947/user/jenkins/test-data/b730b1d0-3de6-43d6-1656-7fdbdcbff0bf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2ceb963800ee4907ac190963d644a42e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 19:03:36,416 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegion(2947): Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=132, compaction requested=false 2023-02-07 19:03:36,417 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:36,417 DEBUG [M:0;jenkins-hbase6:34673] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796616390Disabling compacts and flushes for region at 1675796616390Disabling writes for close at 1675796616390Obtaining lock to block concurrent updates at 1675796616390Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796616390Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57497, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1675796616390Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796616391 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796616392 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796616394 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796616394Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796616411 (+17 ms)Finished flush of dataSize ~56.15 KB/57497, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=132, compaction requested=false at 1675796616416 (+5 ms)Writing region close event to WAL at 1675796616417 (+1 ms)Closed at 1675796616417 2023-02-07 19:03:36,419 INFO [M:0;jenkins-hbase6:34673] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:36,419 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:36,420 INFO [M:0;jenkins-hbase6:34673] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:34673 2023-02-07 19:03:36,423 DEBUG [M:0;jenkins-hbase6:34673] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,34673,1675796612671 already deleted, retry=false 2023-02-07 19:03:36,766 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:36,766 INFO [M:0;jenkins-hbase6:34673] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,34673,1675796612671; zookeeper connection closed. 2023-02-07 19:03:36,766 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5def27b7 rejected from java.util.concurrent.ThreadPoolExecutor@59d0b8d2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,767 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): master:34673-0x1013e983a730000, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:36,767 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@9724877 rejected from java.util.concurrent.ThreadPoolExecutor@59d0b8d2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,866 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:36,866 INFO [RS:1;jenkins-hbase6:44919] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44919,1675796613257; zookeeper connection closed. 2023-02-07 19:03:36,866 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e23707f rejected from java.util.concurrent.ThreadPoolExecutor@39de400c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,866 DEBUG [Listener at localhost/39203-EventThread] zookeeper.ZKWatcher(600): regionserver:44919-0x1013e983a730002, quorum=127.0.0.1:51148, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:36,866 ERROR [Listener at localhost/39203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fff1c1 rejected from java.util.concurrent.ThreadPoolExecutor@39de400c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:36,866 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b8d0b0f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b8d0b0f 2023-02-07 19:03:36,867 INFO [Listener at localhost/39203] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:36,867 WARN [Listener at localhost/39203] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:36,871 INFO [Listener at localhost/39203] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:36,977 WARN [BP-1687414277-172.31.2.20-1675796609224 heartbeating to localhost/127.0.0.1:44947] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:36,977 WARN [BP-1687414277-172.31.2.20-1675796609224 heartbeating to localhost/127.0.0.1:44947] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1687414277-172.31.2.20-1675796609224 (Datanode Uuid 9b898dc7-6c36-488d-860e-b2eba8c77ed3) service to localhost/127.0.0.1:44947 2023-02-07 19:03:36,980 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/dfs/data/data3/current/BP-1687414277-172.31.2.20-1675796609224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:36,981 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/dfs/data/data4/current/BP-1687414277-172.31.2.20-1675796609224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:36,982 WARN [Listener at localhost/39203] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:37,021 INFO [Listener at localhost/39203] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:37,126 WARN [BP-1687414277-172.31.2.20-1675796609224 heartbeating to localhost/127.0.0.1:44947] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:37,126 WARN [BP-1687414277-172.31.2.20-1675796609224 heartbeating to localhost/127.0.0.1:44947] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1687414277-172.31.2.20-1675796609224 (Datanode Uuid 9d51d72c-1050-4983-9ba7-472bda8ecb9a) service to localhost/127.0.0.1:44947 2023-02-07 19:03:37,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/dfs/data/data1/current/BP-1687414277-172.31.2.20-1675796609224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:37,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/cluster_5d8d8af5-2932-108e-1741-573297eaad7d/dfs/data/data2/current/BP-1687414277-172.31.2.20-1675796609224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:37,136 INFO [Listener at localhost/39203] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:37,249 INFO [Listener at localhost/39203] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:37,269 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:37,281 INFO [Listener at localhost/39203] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 230) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44947 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39203 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,34673,1675796612671)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44947 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:44947 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44947 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44947 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:44947 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:44947 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=616 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 349), ProcessCount=169 (was 169), AvailableMemoryMB=4750 (was 4776) 2023-02-07 19:03:37,292 INFO [Listener at localhost/39203] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=169, AvailableMemoryMB=4749 2023-02-07 19:03:37,302 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/hadoop.log.dir so I do NOT create it in target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838 2023-02-07 19:03:37,302 WARN [Listener at localhost/39203] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 19:03:37,302 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/hadoop.tmp.dir so I do NOT create it in target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838 2023-02-07 19:03:37,302 WARN [Listener at localhost/39203] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5b4bb48-b1d4-a18e-c130-2cf2bab172f2/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 19:03:37,302 DEBUG [Listener at localhost/39203] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838 2023-02-07 19:03:37,302 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:03:37,302 INFO [Listener at localhost/39203] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61, deleteOnExit=true 2023-02-07 19:03:37,302 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:03:37,302 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/test.cache.data in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:03:37,303 DEBUG [Listener at localhost/39203] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:03:37,303 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:03:37,304 INFO [Listener at localhost/39203] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:03:37,309 WARN [Listener at localhost/39203] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:37,309 WARN [Listener at localhost/39203] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:37,354 WARN [Listener at localhost/39203] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:37,357 INFO [Listener at localhost/39203] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:37,361 INFO [Listener at localhost/39203] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/java.io.tmpdir/Jetty_localhost_45143_hdfs____.64uvwn/webapp 2023-02-07 19:03:37,454 INFO [Listener at localhost/39203] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45143 2023-02-07 19:03:37,459 WARN [Listener at localhost/39203] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:37,459 WARN [Listener at localhost/39203] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:37,506 WARN [Listener at localhost/36609] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:37,518 WARN [Listener at localhost/36609] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:37,520 WARN [Listener at localhost/36609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:37,521 INFO [Listener at localhost/36609] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:37,526 INFO [Listener at localhost/36609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/java.io.tmpdir/Jetty_localhost_35505_datanode____.m38pfl/webapp 2023-02-07 19:03:37,617 INFO [Listener at localhost/36609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35505 2023-02-07 19:03:37,626 WARN [Listener at localhost/42183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:37,646 WARN [Listener at localhost/42183] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:37,648 WARN [Listener at localhost/42183] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:37,649 INFO [Listener at localhost/42183] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:37,653 INFO [Listener at localhost/42183] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/java.io.tmpdir/Jetty_localhost_33977_datanode____qak6hs/webapp 2023-02-07 19:03:37,742 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87cd43d1c8efb0c7: Processing first storage report for DS-5985d2d5-991d-43ac-8e77-b0a61becc518 from datanode a524b8ad-c541-48df-bcb9-4ca582e32c0f 2023-02-07 19:03:37,742 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87cd43d1c8efb0c7: from storage DS-5985d2d5-991d-43ac-8e77-b0a61becc518 node DatanodeRegistration(127.0.0.1:45593, datanodeUuid=a524b8ad-c541-48df-bcb9-4ca582e32c0f, infoPort=39103, infoSecurePort=0, ipcPort=42183, storageInfo=lv=-57;cid=testClusterID;nsid=1361439756;c=1675796617311), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 19:03:37,743 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87cd43d1c8efb0c7: Processing first storage report for DS-e28ed98a-36cd-41ec-acfa-7ddea0f2115f from datanode a524b8ad-c541-48df-bcb9-4ca582e32c0f 2023-02-07 19:03:37,743 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87cd43d1c8efb0c7: from storage DS-e28ed98a-36cd-41ec-acfa-7ddea0f2115f node DatanodeRegistration(127.0.0.1:45593, datanodeUuid=a524b8ad-c541-48df-bcb9-4ca582e32c0f, infoPort=39103, infoSecurePort=0, ipcPort=42183, storageInfo=lv=-57;cid=testClusterID;nsid=1361439756;c=1675796617311), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:37,750 INFO [Listener at localhost/42183] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33977 2023-02-07 19:03:37,757 WARN [Listener at localhost/34785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:37,871 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6a83ce8dc611291: Processing first storage report for DS-9d67d186-9a4a-423b-b029-050e3632e8a6 from datanode ee9e175b-5665-4687-9099-7b6eccc09bd1 2023-02-07 19:03:37,871 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6a83ce8dc611291: from storage DS-9d67d186-9a4a-423b-b029-050e3632e8a6 node DatanodeRegistration(127.0.0.1:44415, datanodeUuid=ee9e175b-5665-4687-9099-7b6eccc09bd1, infoPort=46409, infoSecurePort=0, ipcPort=34785, storageInfo=lv=-57;cid=testClusterID;nsid=1361439756;c=1675796617311), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:37,871 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6a83ce8dc611291: Processing first storage report for DS-50b0ef86-a70f-479b-a6e3-6ee97c880d27 from datanode ee9e175b-5665-4687-9099-7b6eccc09bd1 2023-02-07 19:03:37,871 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6a83ce8dc611291: from storage DS-50b0ef86-a70f-479b-a6e3-6ee97c880d27 node DatanodeRegistration(127.0.0.1:44415, datanodeUuid=ee9e175b-5665-4687-9099-7b6eccc09bd1, infoPort=46409, infoSecurePort=0, ipcPort=34785, storageInfo=lv=-57;cid=testClusterID;nsid=1361439756;c=1675796617311), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:37,968 DEBUG [Listener at localhost/34785] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838 2023-02-07 19:03:37,971 INFO [Listener at localhost/34785] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/zookeeper_0, clientPort=58403, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:03:37,972 INFO [Listener at localhost/34785] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58403 2023-02-07 19:03:37,972 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:37,973 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:37,986 INFO [Listener at localhost/34785] util.FSUtils(479): Created version file at hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347 with version=8 2023-02-07 19:03:37,986 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:37,986 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:37,987 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36609/user/jenkins/test-data/5658b75f-eafc-be6d-d3bd-a7a9c3f9cf6c/hbase-staging 2023-02-07 19:03:37,989 INFO [Listener at localhost/34785] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:37,989 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:37,989 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:37,989 INFO [Listener at localhost/34785] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:37,990 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:37,990 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:37,990 INFO [Listener at localhost/34785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:37,991 INFO [Listener at localhost/34785] ipc.NettyRpcServer(120): Bind to /172.31.2.20:38053 2023-02-07 19:03:37,991 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:37,992 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:37,992 INFO [Listener at localhost/34785] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38053 connecting to ZooKeeper ensemble=127.0.0.1:58403 2023-02-07 19:03:38,000 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:380530x0, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:38,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38053-0x1013e984f370000 connected 2023-02-07 19:03:38,026 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:38,026 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:38,026 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:38,027 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38053 2023-02-07 19:03:38,027 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38053 2023-02-07 19:03:38,027 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38053 2023-02-07 19:03:38,028 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38053 2023-02-07 19:03:38,028 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38053 2023-02-07 19:03:38,028 INFO [Listener at localhost/34785] master.HMaster(439): hbase.rootdir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347, hbase.cluster.distributed=false 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:38,041 INFO [Listener at localhost/34785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:38,042 INFO [Listener at localhost/34785] ipc.NettyRpcServer(120): Bind to /172.31.2.20:46363 2023-02-07 19:03:38,043 INFO [Listener at localhost/34785] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:38,043 DEBUG [Listener at localhost/34785] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:38,044 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:38,044 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:38,045 INFO [Listener at localhost/34785] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46363 connecting to ZooKeeper ensemble=127.0.0.1:58403 2023-02-07 19:03:38,047 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:463630x0, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:38,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46363-0x1013e984f370001 connected 2023-02-07 19:03:38,049 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:38,049 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:38,049 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:38,050 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46363 2023-02-07 19:03:38,051 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46363 2023-02-07 19:03:38,053 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46363 2023-02-07 19:03:38,053 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46363 2023-02-07 19:03:38,054 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46363 2023-02-07 19:03:38,064 INFO [Listener at localhost/34785] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:38,065 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:38,065 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:38,065 INFO [Listener at localhost/34785] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:38,065 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:38,065 INFO [Listener at localhost/34785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:38,065 INFO [Listener at localhost/34785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:38,067 INFO [Listener at localhost/34785] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39193 2023-02-07 19:03:38,067 INFO [Listener at localhost/34785] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:38,067 DEBUG [Listener at localhost/34785] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:38,068 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:38,069 INFO [Listener at localhost/34785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:38,070 INFO [Listener at localhost/34785] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39193 connecting to ZooKeeper ensemble=127.0.0.1:58403 2023-02-07 19:03:38,072 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:391930x0, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:38,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39193-0x1013e984f370002 connected 2023-02-07 19:03:38,073 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:38,074 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:38,074 DEBUG [Listener at localhost/34785] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:38,078 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39193 2023-02-07 19:03:38,079 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39193 2023-02-07 19:03:38,079 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39193 2023-02-07 19:03:38,079 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39193 2023-02-07 19:03:38,079 DEBUG [Listener at localhost/34785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39193 2023-02-07 19:03:38,081 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,083 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:38,083 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,087 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:38,087 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:38,087 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:38,087 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,088 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:38,091 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,38053,1675796617989 from backup master directory 2023-02-07 19:03:38,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:38,092 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,092 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:38,092 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:38,092 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,108 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/hbase.id with ID: a505e74a-dd3a-4964-9717-ef61480a0a6d 2023-02-07 19:03:38,116 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:38,118 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,129 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x269eaa9b to 127.0.0.1:58403 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:38,132 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25b5855a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:38,133 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:38,133 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:03:38,134 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:38,135 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store-tmp 2023-02-07 19:03:38,144 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:38,144 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:38,144 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:38,145 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:38,145 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:38,145 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:38,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:38,145 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796618144Disabling compacts and flushes for region at 1675796618144Disabling writes for close at 1675796618145 (+1 ms)Writing region close event to WAL at 1675796618145Closed at 1675796618145 2023-02-07 19:03:38,145 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/WALs/jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,147 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C38053%2C1675796617989, suffix=, logDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/WALs/jenkins-hbase6.apache.org,38053,1675796617989, archiveDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/oldWALs, maxLogs=10 2023-02-07 19:03:38,164 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK] 2023-02-07 19:03:38,164 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK] 2023-02-07 19:03:38,166 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/WALs/jenkins-hbase6.apache.org,38053,1675796617989/jenkins-hbase6.apache.org%2C38053%2C1675796617989.1675796618147 2023-02-07 19:03:38,166 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK]] 2023-02-07 19:03:38,166 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:38,167 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:38,167 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:38,167 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:38,170 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:38,171 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:03:38,171 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:03:38,172 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,172 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:38,172 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:38,174 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:38,175 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:38,176 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73691480, jitterRate=0.09808862209320068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:38,176 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796618167Initializing all the Stores at 1675796618167Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796618167Cleaning up temporary data from old regions at 1675796618173 (+6 ms)Cleaning up detritus from prior splits at 1675796618173Region opened successfully at 1675796618176 (+3 ms) 2023-02-07 19:03:38,176 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:03:38,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:03:38,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:03:38,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:03:38,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 19:03:38,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 19:03:38,178 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:03:38,179 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:03:38,179 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:03:38,189 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:03:38,189 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:03:38,190 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:03:38,190 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:03:38,190 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:03:38,193 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,193 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:03:38,194 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:03:38,194 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:03:38,196 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:38,196 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:38,196 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,196 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:38,196 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,38053,1675796617989, sessionid=0x1013e984f370000, setting cluster-up flag (Was=false) 2023-02-07 19:03:38,201 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,209 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:03:38,210 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,213 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,217 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:03:38,218 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:38,218 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.hbase-snapshot/.tmp 2023-02-07 19:03:38,219 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:38,219 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:38,220 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,221 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796648221 2023-02-07 19:03:38,222 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:03:38,222 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:03:38,222 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:03:38,222 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:03:38,222 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:03:38,222 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:03:38,222 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:38,222 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:03:38,223 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:38,223 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,226 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:03:38,226 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:03:38,226 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:03:38,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:03:38,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:03:38,227 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796618227,5,FailOnTimeoutGroup] 2023-02-07 19:03:38,227 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796618227,5,FailOnTimeoutGroup] 2023-02-07 19:03:38,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:03:38,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,227 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,233 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:38,233 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:38,233 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347 2023-02-07 19:03:38,243 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:38,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:38,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/info 2023-02-07 19:03:38,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:38,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:38,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:38,247 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:38,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:38,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/table 2023-02-07 19:03:38,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:38,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,249 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740 2023-02-07 19:03:38,249 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740 2023-02-07 19:03:38,250 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:38,251 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:38,252 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:38,253 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67561595, jitterRate=0.006746217608451843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:38,253 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796618243Initializing all the Stores at 1675796618244 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796618244Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796618244Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796618244Cleaning up temporary data from old regions at 1675796618250 (+6 ms)Cleaning up detritus from prior splits at 1675796618250Region opened successfully at 1675796618253 (+3 ms) 2023-02-07 19:03:38,253 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:38,253 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:38,253 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:38,253 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:38,253 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:38,253 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:38,253 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796618253Disabling compacts and flushes for region at 1675796618253Disabling writes for close at 1675796618253Writing region close event to WAL at 1675796618253Closed at 1675796618253 2023-02-07 19:03:38,254 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:38,254 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:03:38,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:03:38,256 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:03:38,257 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:03:38,282 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(952): ClusterId : a505e74a-dd3a-4964-9717-ef61480a0a6d 2023-02-07 19:03:38,282 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(952): ClusterId : a505e74a-dd3a-4964-9717-ef61480a0a6d 2023-02-07 19:03:38,282 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:38,282 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:38,284 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:38,285 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:38,285 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:38,285 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:38,287 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:38,288 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:38,289 DEBUG [RS:1;jenkins-hbase6:39193] zookeeper.ReadOnlyZKClient(139): Connect 0x173583cf to 127.0.0.1:58403 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:38,289 DEBUG [RS:0;jenkins-hbase6:46363] zookeeper.ReadOnlyZKClient(139): Connect 0x38c6567f to 127.0.0.1:58403 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:38,294 DEBUG [RS:1;jenkins-hbase6:39193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19f26f59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:38,294 DEBUG [RS:0;jenkins-hbase6:46363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3601af17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:38,295 DEBUG [RS:1;jenkins-hbase6:39193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dcde8bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:38,295 DEBUG [RS:0;jenkins-hbase6:46363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@323e3d0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:38,303 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:39193 2023-02-07 19:03:38,303 INFO [RS:1;jenkins-hbase6:39193] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:38,303 INFO [RS:1;jenkins-hbase6:39193] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:38,303 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:38,304 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,38053,1675796617989 with isa=jenkins-hbase6.apache.org/172.31.2.20:39193, startcode=1675796618064 2023-02-07 19:03:38,304 DEBUG [RS:1;jenkins-hbase6:39193] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:38,305 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:39045, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:38,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,307 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347 2023-02-07 19:03:38,307 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36609 2023-02-07 19:03:38,307 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:38,307 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:46363 2023-02-07 19:03:38,308 INFO [RS:0;jenkins-hbase6:46363] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:38,308 INFO [RS:0;jenkins-hbase6:46363] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:38,308 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:38,308 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:38,309 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,38053,1675796617989 with isa=jenkins-hbase6.apache.org/172.31.2.20:46363, startcode=1675796618040 2023-02-07 19:03:38,309 DEBUG [RS:1;jenkins-hbase6:39193] zookeeper.ZKUtil(162): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,309 DEBUG [RS:0;jenkins-hbase6:46363] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:38,309 WARN [RS:1;jenkins-hbase6:39193] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:38,309 INFO [RS:1;jenkins-hbase6:39193] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:38,309 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,39193,1675796618064] 2023-02-07 19:03:38,311 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44657, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:38,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,311 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347 2023-02-07 19:03:38,311 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36609 2023-02-07 19:03:38,312 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:38,316 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:38,316 DEBUG [RS:0;jenkins-hbase6:46363] zookeeper.ZKUtil(162): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,316 WARN [RS:0;jenkins-hbase6:46363] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:38,316 INFO [RS:0;jenkins-hbase6:46363] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:38,317 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,46363,1675796618040] 2023-02-07 19:03:38,317 DEBUG [RS:1;jenkins-hbase6:39193] zookeeper.ZKUtil(162): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,317 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,317 DEBUG [RS:1;jenkins-hbase6:39193] zookeeper.ZKUtil(162): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,318 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:38,318 INFO [RS:1;jenkins-hbase6:39193] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:38,322 INFO [RS:1;jenkins-hbase6:39193] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:38,322 INFO [RS:1;jenkins-hbase6:39193] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:38,322 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,323 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:38,324 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:38,325 DEBUG [RS:0;jenkins-hbase6:46363] zookeeper.ZKUtil(162): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:1;jenkins-hbase6:39193] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,325 DEBUG [RS:0;jenkins-hbase6:46363] zookeeper.ZKUtil(162): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,326 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,326 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,326 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,327 DEBUG [RS:0;jenkins-hbase6:46363] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:38,327 INFO [RS:0;jenkins-hbase6:46363] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:38,329 INFO [RS:0;jenkins-hbase6:46363] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:38,330 INFO [RS:0;jenkins-hbase6:46363] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:38,330 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,331 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:38,332 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,332 DEBUG [RS:0;jenkins-hbase6:46363] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:38,335 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,335 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,335 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,339 INFO [RS:1;jenkins-hbase6:39193] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:38,339 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39193,1675796618064-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,345 INFO [RS:0;jenkins-hbase6:46363] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:38,345 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46363,1675796618040-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,350 INFO [RS:1;jenkins-hbase6:39193] regionserver.Replication(203): jenkins-hbase6.apache.org,39193,1675796618064 started 2023-02-07 19:03:38,350 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,39193,1675796618064, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:39193, sessionid=0x1013e984f370002 2023-02-07 19:03:38,350 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:38,350 DEBUG [RS:1;jenkins-hbase6:39193] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,350 DEBUG [RS:1;jenkins-hbase6:39193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39193,1675796618064' 2023-02-07 19:03:38,350 DEBUG [RS:1;jenkins-hbase6:39193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:38,350 DEBUG [RS:1;jenkins-hbase6:39193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39193,1675796618064' 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:38,351 DEBUG [RS:1;jenkins-hbase6:39193] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:38,351 INFO [RS:1;jenkins-hbase6:39193] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:38,351 INFO [RS:1;jenkins-hbase6:39193] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:38,355 INFO [RS:0;jenkins-hbase6:46363] regionserver.Replication(203): jenkins-hbase6.apache.org,46363,1675796618040 started 2023-02-07 19:03:38,355 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,46363,1675796618040, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:46363, sessionid=0x1013e984f370001 2023-02-07 19:03:38,355 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:38,355 DEBUG [RS:0;jenkins-hbase6:46363] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,355 DEBUG [RS:0;jenkins-hbase6:46363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46363,1675796618040' 2023-02-07 19:03:38,355 DEBUG [RS:0;jenkins-hbase6:46363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:38,355 DEBUG [RS:0;jenkins-hbase6:46363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:38,355 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:38,356 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:38,356 DEBUG [RS:0;jenkins-hbase6:46363] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:38,356 DEBUG [RS:0;jenkins-hbase6:46363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46363,1675796618040' 2023-02-07 19:03:38,356 DEBUG [RS:0;jenkins-hbase6:46363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:38,356 DEBUG [RS:0;jenkins-hbase6:46363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:38,356 DEBUG [RS:0;jenkins-hbase6:46363] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:38,356 INFO [RS:0;jenkins-hbase6:46363] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:38,356 INFO [RS:0;jenkins-hbase6:46363] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:38,407 DEBUG [jenkins-hbase6:38053] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:03:38,407 DEBUG [jenkins-hbase6:38053] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:38,408 DEBUG [jenkins-hbase6:38053] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:38,408 DEBUG [jenkins-hbase6:38053] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:38,409 DEBUG [jenkins-hbase6:38053] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:38,409 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39193,1675796618064, state=OPENING 2023-02-07 19:03:38,464 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:03:38,494 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:38,495 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:38,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39193,1675796618064}] 2023-02-07 19:03:38,650 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,650 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:38,651 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36782, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:38,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:03:38,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:38,656 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39193%2C1675796618064.meta, suffix=.meta, logDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,39193,1675796618064, archiveDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/oldWALs, maxLogs=32 2023-02-07 19:03:38,669 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK] 2023-02-07 19:03:38,669 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK] 2023-02-07 19:03:38,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,39193,1675796618064/jenkins-hbase6.apache.org%2C39193%2C1675796618064.meta.1675796618657.meta 2023-02-07 19:03:38,671 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK]] 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:03:38,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:03:38,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:03:38,673 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:38,674 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/info 2023-02-07 19:03:38,674 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/info 2023-02-07 19:03:38,674 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:38,675 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,675 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:38,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:38,676 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:38,676 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:38,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:38,677 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/table 2023-02-07 19:03:38,677 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/table 2023-02-07 19:03:38,677 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:38,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:38,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740 2023-02-07 19:03:38,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740 2023-02-07 19:03:38,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:38,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:38,682 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63215568, jitterRate=-0.058014631271362305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:38,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796618672Writing region info on filesystem at 1675796618672Initializing all the Stores at 1675796618673 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796618673Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796618673Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796618673Cleaning up temporary data from old regions at 1675796618680 (+7 ms)Cleaning up detritus from prior splits at 1675796618680Running coprocessor post-open hooks at 1675796618682 (+2 ms)Region opened successfully at 1675796618682 2023-02-07 19:03:38,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796618650 2023-02-07 19:03:38,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:03:38,687 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:03:38,687 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39193,1675796618064, state=OPEN 2023-02-07 19:03:38,689 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:03:38,689 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:38,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:03:38,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39193,1675796618064 in 195 msec 2023-02-07 19:03:38,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:03:38,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 437 msec 2023-02-07 19:03:38,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 473 msec 2023-02-07 19:03:38,693 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796618083, completionTime=-1 2023-02-07 19:03:38,693 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:03:38,693 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:03:38,696 DEBUG [hconnection-0x19edf616-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:38,697 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36792, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:38,698 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:03:38,698 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796678698 2023-02-07 19:03:38,698 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796738698 2023-02-07 19:03:38,698 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38053,1675796617989-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38053,1675796617989-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38053,1675796617989-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:38053, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:03:38,708 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:38,709 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:03:38,710 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:03:38,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:38,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:38,712 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:38,712 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32 empty. 2023-02-07 19:03:38,713 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:38,713 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:03:38,725 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:38,726 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1015fb38aa046a0f1c22905c85a9cb32, NAME => 'hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp 2023-02-07 19:03:38,733 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:38,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 1015fb38aa046a0f1c22905c85a9cb32, disabling compactions & flushes 2023-02-07 19:03:38,734 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:38,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:38,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. after waiting 0 ms 2023-02-07 19:03:38,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:38,734 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:38,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 1015fb38aa046a0f1c22905c85a9cb32: Waiting for close lock at 1675796618734Disabling compacts and flushes for region at 1675796618734Disabling writes for close at 1675796618734Writing region close event to WAL at 1675796618734Closed at 1675796618734 2023-02-07 19:03:38,736 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:38,736 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796618736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796618736"}]},"ts":"1675796618736"} 2023-02-07 19:03:38,738 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:38,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:38,739 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796618738"}]},"ts":"1675796618738"} 2023-02-07 19:03:38,739 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:03:38,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:38,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:38,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:38,746 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:38,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1015fb38aa046a0f1c22905c85a9cb32, ASSIGN}] 2023-02-07 19:03:38,749 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1015fb38aa046a0f1c22905c85a9cb32, ASSIGN 2023-02-07 19:03:38,749 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1015fb38aa046a0f1c22905c85a9cb32, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39193,1675796618064; forceNewPlan=false, retain=false 2023-02-07 19:03:38,900 INFO [jenkins-hbase6:38053] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:38,900 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1015fb38aa046a0f1c22905c85a9cb32, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:38,900 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796618900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796618900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796618900"}]},"ts":"1675796618900"} 2023-02-07 19:03:38,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1015fb38aa046a0f1c22905c85a9cb32, server=jenkins-hbase6.apache.org,39193,1675796618064}] 2023-02-07 19:03:39,057 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:39,058 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39193%2C1675796618064, suffix=, logDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,39193,1675796618064, archiveDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/oldWALs, maxLogs=32 2023-02-07 19:03:39,071 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK] 2023-02-07 19:03:39,071 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK] 2023-02-07 19:03:39,075 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,39193,1675796618064/jenkins-hbase6.apache.org%2C39193%2C1675796618064.1675796619058 2023-02-07 19:03:39,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK]] 2023-02-07 19:03:39,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1015fb38aa046a0f1c22905c85a9cb32, NAME => 'hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:39,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:39,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,078 INFO [StoreOpener-1015fb38aa046a0f1c22905c85a9cb32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,079 DEBUG [StoreOpener-1015fb38aa046a0f1c22905c85a9cb32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/info 2023-02-07 19:03:39,079 DEBUG [StoreOpener-1015fb38aa046a0f1c22905c85a9cb32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/info 2023-02-07 19:03:39,080 INFO [StoreOpener-1015fb38aa046a0f1c22905c85a9cb32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1015fb38aa046a0f1c22905c85a9cb32 columnFamilyName info 2023-02-07 19:03:39,080 INFO [StoreOpener-1015fb38aa046a0f1c22905c85a9cb32-1] regionserver.HStore(310): Store=1015fb38aa046a0f1c22905c85a9cb32/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:39,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:39,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:39,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1015fb38aa046a0f1c22905c85a9cb32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63790401, jitterRate=-0.049448952078819275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:39,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1015fb38aa046a0f1c22905c85a9cb32: Running coprocessor pre-open hook at 1675796619076Writing region info on filesystem at 1675796619076Initializing all the Stores at 1675796619076Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796619076Cleaning up temporary data from old regions at 1675796619081 (+5 ms)Cleaning up detritus from prior splits at 1675796619081Running coprocessor post-open hooks at 1675796619085 (+4 ms)Region opened successfully at 1675796619085 2023-02-07 19:03:39,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32., pid=6, masterSystemTime=1675796619053 2023-02-07 19:03:39,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:39,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:39,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1015fb38aa046a0f1c22905c85a9cb32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796619087"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796619087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796619087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796619087"}]},"ts":"1675796619087"} 2023-02-07 19:03:39,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:03:39,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1015fb38aa046a0f1c22905c85a9cb32, server=jenkins-hbase6.apache.org,39193,1675796618064 in 186 msec 2023-02-07 19:03:39,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:03:39,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1015fb38aa046a0f1c22905c85a9cb32, ASSIGN in 343 msec 2023-02-07 19:03:39,091 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:39,092 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796619092"}]},"ts":"1675796619092"} 2023-02-07 19:03:39,093 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:03:39,095 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:39,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 387 msec 2023-02-07 19:03:39,110 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:03:39,112 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:39,112 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:39,115 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:03:39,122 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:39,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-07 19:03:39,127 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:03:39,132 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:39,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-07 19:03:39,140 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:03:39,144 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:03:39,144 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.052sec 2023-02-07 19:03:39,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:03:39,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:03:39,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:03:39,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38053,1675796617989-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:03:39,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38053,1675796617989-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:03:39,146 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:03:39,182 DEBUG [Listener at localhost/34785] zookeeper.ReadOnlyZKClient(139): Connect 0x385338df to 127.0.0.1:58403 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:39,185 DEBUG [Listener at localhost/34785] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@317ef89c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:39,186 DEBUG [hconnection-0x64d6a17c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:39,188 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:39,190 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:39,190 DEBUG [Listener at localhost/34785] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:03:39,190 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,190 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,192 DEBUG [Listener at localhost/34785] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:03:39,193 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38148, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:03:39,194 INFO [Listener at localhost/34785] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:39,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:39,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:03:39,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.2.20:38148 deadline: 1675796679194, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:39,195 INFO [Listener at localhost/34785] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 19:03:39,195 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,195 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:39,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:39,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:39,199 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:39,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-07 19:03:39,199 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,199 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:39,199 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:39,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:39,201 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,201 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d empty. 2023-02-07 19:03:39,202 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,202 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-07 19:03:39,214 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:39,215 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 96ae05f5b289e4f6cd0f63d8f395421d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp 2023-02-07 19:03:39,221 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:39,221 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 96ae05f5b289e4f6cd0f63d8f395421d, disabling compactions & flushes 2023-02-07 19:03:39,221 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,221 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,221 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. after waiting 0 ms 2023-02-07 19:03:39,221 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,221 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,222 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 96ae05f5b289e4f6cd0f63d8f395421d: Waiting for close lock at 1675796619221Disabling compacts and flushes for region at 1675796619221Disabling writes for close at 1675796619221Writing region close event to WAL at 1675796619221Closed at 1675796619221 2023-02-07 19:03:39,223 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:39,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675796619224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796619224"}]},"ts":"1675796619224"} 2023-02-07 19:03:39,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:39,226 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:39,226 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796619226"}]},"ts":"1675796619226"} 2023-02-07 19:03:39,227 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-07 19:03:39,230 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:39,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:39,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:39,231 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:39,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, ASSIGN}] 2023-02-07 19:03:39,233 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, ASSIGN 2023-02-07 19:03:39,234 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39193,1675796618064; forceNewPlan=false, retain=false 2023-02-07 19:03:39,278 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 19:03:39,300 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,301 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:39,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:39,358 INFO [RS:0;jenkins-hbase6:46363] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46363%2C1675796618040, suffix=, logDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,46363,1675796618040, archiveDir=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/oldWALs, maxLogs=32 2023-02-07 19:03:39,374 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK] 2023-02-07 19:03:39,374 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK] 2023-02-07 19:03:39,379 INFO [RS:0;jenkins-hbase6:46363] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/WALs/jenkins-hbase6.apache.org,46363,1675796618040/jenkins-hbase6.apache.org%2C46363%2C1675796618040.1675796619358 2023-02-07 19:03:39,380 DEBUG [RS:0;jenkins-hbase6:46363] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44415,DS-9d67d186-9a4a-423b-b029-050e3632e8a6,DISK], DatanodeInfoWithStorage[127.0.0.1:45593,DS-5985d2d5-991d-43ac-8e77-b0a61becc518,DISK]] 2023-02-07 19:03:39,384 INFO [jenkins-hbase6:38053] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:39,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=96ae05f5b289e4f6cd0f63d8f395421d, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675796619384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796619384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796619384"}]},"ts":"1675796619384"} 2023-02-07 19:03:39,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 96ae05f5b289e4f6cd0f63d8f395421d, server=jenkins-hbase6.apache.org,39193,1675796618064}] 2023-02-07 19:03:39,504 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,505 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:39,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:39,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 96ae05f5b289e4f6cd0f63d8f395421d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:39,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:39,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,545 INFO [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,546 DEBUG [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1 2023-02-07 19:03:39,546 DEBUG [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1 2023-02-07 19:03:39,547 INFO [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96ae05f5b289e4f6cd0f63d8f395421d columnFamilyName f1 2023-02-07 19:03:39,547 INFO [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] regionserver.HStore(310): Store=96ae05f5b289e4f6cd0f63d8f395421d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:39,547 INFO [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,548 DEBUG [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2 2023-02-07 19:03:39,548 DEBUG [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2 2023-02-07 19:03:39,548 INFO [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96ae05f5b289e4f6cd0f63d8f395421d columnFamilyName f2 2023-02-07 19:03:39,549 INFO [StoreOpener-96ae05f5b289e4f6cd0f63d8f395421d-1] regionserver.HStore(310): Store=96ae05f5b289e4f6cd0f63d8f395421d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:39,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:39,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:39,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:39,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 96ae05f5b289e4f6cd0f63d8f395421d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63457809, jitterRate=-0.054404959082603455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:39,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 96ae05f5b289e4f6cd0f63d8f395421d: Running coprocessor pre-open hook at 1675796619544Writing region info on filesystem at 1675796619544Initializing all the Stores at 1675796619545 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796619545Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796619545Cleaning up temporary data from old regions at 1675796619550 (+5 ms)Cleaning up detritus from prior splits at 1675796619550Running coprocessor post-open hooks at 1675796619554 (+4 ms)Region opened successfully at 1675796619554 2023-02-07 19:03:39,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d., pid=12, masterSystemTime=1675796619541 2023-02-07 19:03:39,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,556 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=96ae05f5b289e4f6cd0f63d8f395421d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675796619556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796619556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796619556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796619556"}]},"ts":"1675796619556"} 2023-02-07 19:03:39,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 19:03:39,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 96ae05f5b289e4f6cd0f63d8f395421d, server=jenkins-hbase6.apache.org,39193,1675796618064 in 170 msec 2023-02-07 19:03:39,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 19:03:39,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, ASSIGN in 328 msec 2023-02-07 19:03:39,560 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:39,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796619560"}]},"ts":"1675796619560"} 2023-02-07 19:03:39,561 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-07 19:03:39,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:39,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 368 msec 2023-02-07 19:03:39,806 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,806 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:39,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:39,808 INFO [Listener at localhost/34785] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-07 19:03:39,808 DEBUG [Listener at localhost/34785] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-07 19:03:39,808 INFO [Listener at localhost/34785] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:39,810 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-07 19:03:39,810 INFO [Listener at localhost/34785] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:39,810 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-07 19:03:39,810 INFO [Listener at localhost/34785] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:03:39,838 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39193] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,916 INFO [Listener at localhost/34785] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:03:39,917 INFO [Listener at localhost/34785] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:03:39,917 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:39,917 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:39,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 19:03:39,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796619918 (current time:1675796619918). 2023-02-07 19:03:39,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:03:39,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] zookeeper.ReadOnlyZKClient(139): Connect 0x2ccf0f65 to 127.0.0.1:58403 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:39,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@275d5bc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:39,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:39,924 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:39,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ccf0f65 to 127.0.0.1:58403 2023-02-07 19:03:39,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:39,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:03:39,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 19:03:39,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 19:03:39,946 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 19:03:39,947 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675797219946 2023-02-07 19:03:39,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 19:03:39,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:39,948 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:39,948 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:03:39,949 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 19:03:39,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 19:03:39,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 23 msec 2023-02-07 19:03:39,951 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 19:03:39,951 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675797219951 2023-02-07 19:03:39,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-07 19:03:39,960 INFO [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-07 19:03:39,960 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:39,961 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-07 19:03:39,961 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-07 19:03:39,962 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 19:03:39,962 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:39,964 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:39,964 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:39,964 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:39,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:39,964 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,964 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 19:03:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 19:03:39,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 19:03:39,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 19:03:39,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 19:03:39,965 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 19:03:39,965 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:39,965 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 19:03:39,966 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 19:03:39,966 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:39,966 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 19:03:39,966 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39193,1675796618064' joining acquired barrier for procedure (foo) in zk 2023-02-07 19:03:39,967 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 19:03:39,967 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 19:03:39,967 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46363,1675796618040' joining acquired barrier for procedure (foo) in zk 2023-02-07 19:03:39,969 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,969 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,969 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:39,969 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,969 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,969 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:39,970 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:39,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39193,1675796618064' joining acquired barrier for procedure 'foo' on coordinator 2023-02-07 19:03:39,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c217a2b[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:39,971 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-07 19:03:39,971 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,972 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,972 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,973 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 19:03:39,973 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 19:03:39,973 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:39,973 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 19:03:39,973 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:39,973 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 19:03:39,973 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 19:03:39,973 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,46363,1675796618040' in zk 2023-02-07 19:03:39,973 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:39,973 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. started... 2023-02-07 19:03:39,973 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 96ae05f5b289e4f6cd0f63d8f395421d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 19:03:39,975 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 19:03:39,975 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:39,975 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 19:03:39,989 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f1/efe9b005a0264db6baa141c711a22e9c 2023-02-07 19:03:40,005 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f2/a287ad8572dc4d2993377cc5a317addc 2023-02-07 19:03:40,010 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f1/efe9b005a0264db6baa141c711a22e9c as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c 2023-02-07 19:03:40,013 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:40,014 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f2/a287ad8572dc4d2993377cc5a317addc as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc 2023-02-07 19:03:40,018 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:40,019 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 96ae05f5b289e4f6cd0f63d8f395421d in 46ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:40,019 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 19:03:40,019 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 96ae05f5b289e4f6cd0f63d8f395421d: 2023-02-07 19:03:40,019 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.' region-info for snapshot=foo 2023-02-07 19:03:40,019 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:40,019 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c] hfiles 2023-02-07 19:03:40,019 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c for snapshot=foo 2023-02-07 19:03:40,020 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc] hfiles 2023-02-07 19:03:40,020 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc for snapshot=foo 2023-02-07 19:03:40,029 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. completed. 2023-02-07 19:03:40,029 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,030 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 19:03:40,030 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 19:03:40,030 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,030 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 19:03:40,030 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,39193,1675796618064' in zk 2023-02-07 19:03:40,031 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,031 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 19:03:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:40,031 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:40,032 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 19:03:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase6.apache.org,39193,1675796618064': 2023-02-07 19:03:40,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39193,1675796618064' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-07 19:03:40,034 INFO [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-07 19:03:40,035 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:40,035 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:40,035 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-07 19:03:40,035 INFO [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:40,037 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:40,037 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,037 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:40,038 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,038 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:40,039 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 19:03:40,040 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,045 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,045 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:40,045 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,045 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:40,045 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:40,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:40,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-07 19:03:40,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:40,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:40,046 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:40,045 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 19:03:40,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-07 19:03:40,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:40,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 19:03:40,046 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 19:03:40,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:40,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:40,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.hbase-snapshot/.tmp/foo 2023-02-07 19:03:40,049 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:40,049 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,049 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-07 19:03:40,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:40,051 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:03:40,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.hbase-snapshot/.tmp/foo to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.hbase-snapshot/foo 2023-02-07 19:03:40,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-07 19:03:40,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.hbase-snapshot/.tmp/foo 2023-02-07 19:03:40,075 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.hbase-snapshot/.tmp/foo 2023-02-07 19:03:40,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675796619947Consolidate snapshot: foo at 1675796620046 (+99 ms)Loading Region manifests for foo at 1675796620046Writing data manifest for foo at 1675796620049 (+3 ms)Verifying snapshot: foo at 1675796620055 (+6 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675796620074 (+19 ms) 2023-02-07 19:03:40,076 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 19:03:40,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 128 msec 2023-02-07 19:03:40,251 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:40,251 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,251 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-07 19:03:40,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:40,252 INFO [Listener at localhost/34785] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:40,253 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,253 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,256 INFO [Listener at localhost/34785] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:40,260 INFO [Listener at localhost/34785] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:40,287 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39193] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,364 INFO [Listener at localhost/34785] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:40,367 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,367 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:40,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,371 INFO [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 19:03:40,371 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:40,372 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-07 19:03:40,372 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-07 19:03:40,372 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,372 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,374 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:40,374 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:40,374 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:40,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:40,374 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,374 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,375 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-07 19:03:40,375 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:40,376 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-07 19:03:40,376 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-07 19:03:40,376 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-07 19:03:40,376 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46363,1675796618040' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-07 19:03:40,376 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:40,377 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-07 19:03:40,377 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 19:03:40,377 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:40,377 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,377 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. started... 2023-02-07 19:03:40,377 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 96ae05f5b289e4f6cd0f63d8f395421d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 19:03:40,379 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,379 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,379 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:40,391 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f1/d61cdc322c954c9ea65fff32c25a8f87 2023-02-07 19:03:40,414 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f2/2dc71be861c940aeab242b6223753338 2023-02-07 19:03:40,418 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f1/d61cdc322c954c9ea65fff32c25a8f87 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/d61cdc322c954c9ea65fff32c25a8f87 2023-02-07 19:03:40,421 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/d61cdc322c954c9ea65fff32c25a8f87, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:40,422 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/.tmp/f2/2dc71be861c940aeab242b6223753338 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/2dc71be861c940aeab242b6223753338 2023-02-07 19:03:40,426 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/2dc71be861c940aeab242b6223753338, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:40,427 INFO [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 96ae05f5b289e4f6cd0f63d8f395421d in 50ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:40,428 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 96ae05f5b289e4f6cd0f63d8f395421d: 2023-02-07 19:03:40,428 DEBUG [rs(jenkins-hbase6.apache.org,39193,1675796618064)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,428 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 19:03:40,428 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 19:03:40,428 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,428 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-07 19:03:40,428 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39193,1675796618064' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-07 19:03:40,429 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,430 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:40,430 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,430 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:40,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:40,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39193,1675796618064' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-07 19:03:40,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@281efb77[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:40,432 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-07 19:03:40,432 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,433 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:40,433 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-07 19:03:40,433 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-07 19:03:40,433 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-07 19:03:40,433 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-07 19:03:40,433 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase6.apache.org,39193,1675796618064' in zk 2023-02-07 19:03:40,433 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase6.apache.org,46363,1675796618040' in zk 2023-02-07 19:03:40,435 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-07 19:03:40,435 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:40,435 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-07 19:03:40,435 DEBUG [member: 'jenkins-hbase6.apache.org,46363,1675796618040' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-07 19:03:40,435 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:40,435 DEBUG [member: 'jenkins-hbase6.apache.org,39193,1675796618064' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-07 19:03:40,438 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase6.apache.org,39193,1675796618064': 2023-02-07 19:03:40,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39193,1675796618064' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-07 19:03:40,441 INFO [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-07 19:03:40,441 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:40,441 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:40,441 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,441 INFO [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:40,444 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:40,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:40,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:40,444 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:40,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:40,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,445 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:40,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,446 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,446 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:40,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 19:03:40,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:40,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:40,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,449 DEBUG [(jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,449 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:40,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:40,450 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:40,450 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:40,450 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:40,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:40,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:40,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:40,550 DEBUG [Listener at localhost/34785] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:40,550 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,550 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:40,556 INFO [Listener at localhost/34785] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675796619918 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:40,556 DEBUG [Listener at localhost/34785] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36609/user/jenkins/test-data/5658b75f-eafc-be6d-d3bd-a7a9c3f9cf6c/foo/b416c1ee-944a-4e69-b077-cc30daf61a00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,556 INFO [Listener at localhost/34785] snapshot.RestoreSnapshotHelper(239): region to add: 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:40,556 INFO [Listener at localhost/34785] snapshot.RestoreSnapshotHelper(585): clone region=96ae05f5b289e4f6cd0f63d8f395421d as 96ae05f5b289e4f6cd0f63d8f395421d in snapshot foo 2023-02-07 19:03:40,557 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 96ae05f5b289e4f6cd0f63d8f395421d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36609/user/jenkins/test-data/5658b75f-eafc-be6d-d3bd-a7a9c3f9cf6c/foo/b416c1ee-944a-4e69-b077-cc30daf61a00 2023-02-07 19:03:40,563 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:40,563 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink efe9b005a0264db6baa141c711a22e9c from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,564 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a287ad8572dc4d2993377cc5a317addc from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 96ae05f5b289e4f6cd0f63d8f395421d, disabling compactions & flushes 2023-02-07 19:03:40,566 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. after waiting 0 ms 2023-02-07 19:03:40,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,566 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,566 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 96ae05f5b289e4f6cd0f63d8f395421d: Waiting for close lock at 1675796620566Disabling compacts and flushes for region at 1675796620566Disabling writes for close at 1675796620566Writing region close event to WAL at 1675796620566Closed at 1675796620566 2023-02-07 19:03:40,568 INFO [Listener at localhost/34785] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675796619918 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:40,568 DEBUG [Listener at localhost/34785] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36609/user/jenkins/test-data/5658b75f-eafc-be6d-d3bd-a7a9c3f9cf6c/foo/b416c1ee-944a-4e69-b077-cc30daf61a00 2023-02-07 19:03:40,568 DEBUG [Listener at localhost/34785] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36609/user/jenkins/test-data/5658b75f-eafc-be6d-d3bd-a7a9c3f9cf6c/foo/b416c1ee-944a-4e69-b077-cc30daf61a00 2023-02-07 19:03:40,569 DEBUG [Listener at localhost/34785] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:40,569 DEBUG [Listener at localhost/34785] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:40,569 DEBUG [Listener at localhost/34785] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-07 19:03:40,570 DEBUG [Listener at localhost/34785] util.CommonFSUtils(699): |----------96ae05f5b289e4f6cd0f63d8f395421d/ 2023-02-07 19:03:40,570 DEBUG [Listener at localhost/34785] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:40,570 DEBUG [Listener at localhost/34785] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:40,570 DEBUG [Listener at localhost/34785] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=96ae05f5b289e4f6cd0f63d8f395421d-efe9b005a0264db6baa141c711a22e9c 2023-02-07 19:03:40,571 DEBUG [Listener at localhost/34785] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:40,571 DEBUG [Listener at localhost/34785] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=96ae05f5b289e4f6cd0f63d8f395421d-a287ad8572dc4d2993377cc5a317addc hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/d61cdc322c954c9ea65fff32c25a8f87 hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/2dc71be861c940aeab242b6223753338 hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc 2023-02-07 19:03:40,576 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,576 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "foo" 2023-02-07 19:03:40,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-07 19:03:40,579 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,580 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,580 INFO [Listener at localhost/34785] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,583 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,583 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796620583"}]},"ts":"1675796620583"} 2023-02-07 19:03:40,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:40,585 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-07 19:03:40,586 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-07 19:03:40,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, UNASSIGN}] 2023-02-07 19:03:40,588 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, UNASSIGN 2023-02-07 19:03:40,588 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=96ae05f5b289e4f6cd0f63d8f395421d, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:40,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675796620588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796620588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796620588"}]},"ts":"1675796620588"} 2023-02-07 19:03:40,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 96ae05f5b289e4f6cd0f63d8f395421d, server=jenkins-hbase6.apache.org,39193,1675796618064}] 2023-02-07 19:03:40,684 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,684 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:40,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:40,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 96ae05f5b289e4f6cd0f63d8f395421d, disabling compactions & flushes 2023-02-07 19:03:40,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. after waiting 0 ms 2023-02-07 19:03:40,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:40,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d. 2023-02-07 19:03:40,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 96ae05f5b289e4f6cd0f63d8f395421d: Waiting for close lock at 1675796620744Running coprocessor pre-close hooks at 1675796620744Disabling compacts and flushes for region at 1675796620744Disabling writes for close at 1675796620744Writing region close event to WAL at 1675796620745 (+1 ms)Running coprocessor post-close hooks at 1675796620748 (+3 ms)Closed at 1675796620748 2023-02-07 19:03:40,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:40,750 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=96ae05f5b289e4f6cd0f63d8f395421d, regionState=CLOSED 2023-02-07 19:03:40,750 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675796620750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796620750"}]},"ts":"1675796620750"} 2023-02-07 19:03:40,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 19:03:40,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 96ae05f5b289e4f6cd0f63d8f395421d, server=jenkins-hbase6.apache.org,39193,1675796618064 in 161 msec 2023-02-07 19:03:40,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 19:03:40,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=96ae05f5b289e4f6cd0f63d8f395421d, UNASSIGN in 165 msec 2023-02-07 19:03:40,754 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796620754"}]},"ts":"1675796620754"} 2023-02-07 19:03:40,755 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-07 19:03:40,757 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-07 19:03:40,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 178 msec 2023-02-07 19:03:40,886 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,886 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:40,887 INFO [Listener at localhost/34785] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-07 19:03:40,888 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,888 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,891 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,891 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,891 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,891 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:40,894 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:40,896 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1, FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2, FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/recovered.edits] 2023-02-07 19:03:40,899 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/d61cdc322c954c9ea65fff32c25a8f87 to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/d61cdc322c954c9ea65fff32c25a8f87 2023-02-07 19:03:40,900 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f1/efe9b005a0264db6baa141c711a22e9c 2023-02-07 19:03:40,903 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/2dc71be861c940aeab242b6223753338 to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/2dc71be861c940aeab242b6223753338 2023-02-07 19:03:40,904 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/f2/a287ad8572dc4d2993377cc5a317addc 2023-02-07 19:03:40,906 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/recovered.edits/12.seqid to hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d/recovered.edits/12.seqid 2023-02-07 19:03:40,906 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/96ae05f5b289e4f6cd0f63d8f395421d 2023-02-07 19:03:40,906 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-07 19:03:40,908 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,910 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-07 19:03:40,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-07 19:03:40,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-07 19:03:40,915 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796620915"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:40,916 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 19:03:40,917 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 96ae05f5b289e4f6cd0f63d8f395421d, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675796619197.96ae05f5b289e4f6cd0f63d8f395421d.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 19:03:40,917 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-07 19:03:40,917 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675796620917"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:40,918 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-07 19:03:40,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 19:03:40,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 38 msec 2023-02-07 19:03:40,992 INFO [Listener at localhost/34785] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:40,992 INFO [Listener at localhost/34785] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:40,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38053] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:40,994 INFO [Listener at localhost/34785] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-07 19:03:40,994 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:40,994 INFO [Listener at localhost/34785] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:40,994 DEBUG [Listener at localhost/34785] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x385338df to 127.0.0.1:58403 2023-02-07 19:03:40,994 DEBUG [Listener at localhost/34785] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:40,995 DEBUG [Listener at localhost/34785] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:40,995 DEBUG [Listener at localhost/34785] util.JVMClusterUtil(257): Found active master hash=1231317117, stopped=false 2023-02-07 19:03:40,995 INFO [Listener at localhost/34785] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:40,997 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:40,997 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:40,997 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:40,997 INFO [Listener at localhost/34785] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:40,997 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:40,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:40,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:40,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:40,999 DEBUG [Listener at localhost/34785] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x269eaa9b to 127.0.0.1:58403 2023-02-07 19:03:40,999 DEBUG [Listener at localhost/34785] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:40,999 INFO [Listener at localhost/34785] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,46363,1675796618040' ***** 2023-02-07 19:03:40,999 INFO [Listener at localhost/34785] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:40,999 INFO [Listener at localhost/34785] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39193,1675796618064' ***** 2023-02-07 19:03:41,000 INFO [Listener at localhost/34785] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:41,000 INFO [RS:0;jenkins-hbase6:46363] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:41,000 INFO [RS:0;jenkins-hbase6:46363] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:41,000 INFO [RS:0;jenkins-hbase6:46363] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:41,000 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:41,000 DEBUG [RS:0;jenkins-hbase6:46363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38c6567f to 127.0.0.1:58403 2023-02-07 19:03:41,000 DEBUG [RS:0;jenkins-hbase6:46363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:41,000 INFO [RS:1;jenkins-hbase6:39193] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:41,000 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:41,000 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,46363,1675796618040; all regions closed. 2023-02-07 19:03:41,000 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:41,000 INFO [RS:1;jenkins-hbase6:39193] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:41,002 INFO [RS:1;jenkins-hbase6:39193] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:41,002 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(3304): Received CLOSE for 1015fb38aa046a0f1c22905c85a9cb32 2023-02-07 19:03:41,002 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:41,002 DEBUG [RS:1;jenkins-hbase6:39193] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x173583cf to 127.0.0.1:58403 2023-02-07 19:03:41,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1015fb38aa046a0f1c22905c85a9cb32, disabling compactions & flushes 2023-02-07 19:03:41,002 DEBUG [RS:1;jenkins-hbase6:39193] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:41,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:41,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:41,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. after waiting 0 ms 2023-02-07 19:03:41,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:41,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1015fb38aa046a0f1c22905c85a9cb32 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:41,002 INFO [RS:1;jenkins-hbase6:39193] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:41,003 INFO [RS:1;jenkins-hbase6:39193] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:41,003 INFO [RS:1;jenkins-hbase6:39193] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:41,003 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:41,003 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-07 19:03:41,003 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1479): Online Regions={1015fb38aa046a0f1c22905c85a9cb32=hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32., 1588230740=hbase:meta,,1.1588230740} 2023-02-07 19:03:41,003 DEBUG [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1505): Waiting on 1015fb38aa046a0f1c22905c85a9cb32, 1588230740 2023-02-07 19:03:41,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:41,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:41,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:41,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:41,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:41,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-07 19:03:41,007 DEBUG [RS:0;jenkins-hbase6:46363] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/oldWALs 2023-02-07 19:03:41,007 INFO [RS:0;jenkins-hbase6:46363] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46363%2C1675796618040:(num 1675796619358) 2023-02-07 19:03:41,007 DEBUG [RS:0;jenkins-hbase6:46363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:41,007 INFO [RS:0;jenkins-hbase6:46363] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:41,008 INFO [RS:0;jenkins-hbase6:46363] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:41,009 INFO [RS:0;jenkins-hbase6:46363] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:41,009 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:41,009 INFO [RS:0;jenkins-hbase6:46363] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:41,010 INFO [RS:0;jenkins-hbase6:46363] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:41,011 INFO [RS:0;jenkins-hbase6:46363] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:46363 2023-02-07 19:03:41,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/.tmp/info/fc7daa1b1f7a4920a1ed62c08ac36487 2023-02-07 19:03:41,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/.tmp/info/fc7daa1b1f7a4920a1ed62c08ac36487 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/info/fc7daa1b1f7a4920a1ed62c08ac36487 2023-02-07 19:03:41,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/.tmp/info/3eedf122a5b7407790af032443c64f20 2023-02-07 19:03:41,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/info/fc7daa1b1f7a4920a1ed62c08ac36487, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:41,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3eedf122a5b7407790af032443c64f20 2023-02-07 19:03:41,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1015fb38aa046a0f1c22905c85a9cb32 in 21ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:41,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/namespace/1015fb38aa046a0f1c22905c85a9cb32/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:41,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:41,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1015fb38aa046a0f1c22905c85a9cb32: Waiting for close lock at 1675796621002Running coprocessor pre-close hooks at 1675796621002Disabling compacts and flushes for region at 1675796621002Disabling writes for close at 1675796621002Obtaining lock to block concurrent updates at 1675796621003 (+1 ms)Preparing flush snapshotting stores in 1015fb38aa046a0f1c22905c85a9cb32 at 1675796621003Finished memstore snapshotting hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796621003Flushing stores of hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. at 1675796621003Flushing 1015fb38aa046a0f1c22905c85a9cb32/info: creating writer at 1675796621003Flushing 1015fb38aa046a0f1c22905c85a9cb32/info: appending metadata at 1675796621006 (+3 ms)Flushing 1015fb38aa046a0f1c22905c85a9cb32/info: closing flushed file at 1675796621006Flushing 1015fb38aa046a0f1c22905c85a9cb32/info: reopening flushed file at 1675796621019 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1015fb38aa046a0f1c22905c85a9cb32 in 21ms, sequenceid=6, compaction requested=false at 1675796621024 (+5 ms)Writing region close event to WAL at 1675796621024Running coprocessor post-close hooks at 1675796621027 (+3 ms)Closed at 1675796621028 (+1 ms) 2023-02-07 19:03:41,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796618708.1015fb38aa046a0f1c22905c85a9cb32. 2023-02-07 19:03:41,029 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:41,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/.tmp/rep_barrier/f18fb96980b74d79819382d97ea421c4 2023-02-07 19:03:41,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f18fb96980b74d79819382d97ea421c4 2023-02-07 19:03:41,040 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:41,042 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/.tmp/table/af3b12b932a24bf48c76b1fc505ce2c4 2023-02-07 19:03:41,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af3b12b932a24bf48c76b1fc505ce2c4 2023-02-07 19:03:41,046 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/.tmp/info/3eedf122a5b7407790af032443c64f20 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/info/3eedf122a5b7407790af032443c64f20 2023-02-07 19:03:41,049 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3eedf122a5b7407790af032443c64f20 2023-02-07 19:03:41,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/info/3eedf122a5b7407790af032443c64f20, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 19:03:41,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/.tmp/rep_barrier/f18fb96980b74d79819382d97ea421c4 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/rep_barrier/f18fb96980b74d79819382d97ea421c4 2023-02-07 19:03:41,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f18fb96980b74d79819382d97ea421c4 2023-02-07 19:03:41,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/rep_barrier/f18fb96980b74d79819382d97ea421c4, entries=1, sequenceid=21, filesize=5.1 K 2023-02-07 19:03:41,054 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/.tmp/table/af3b12b932a24bf48c76b1fc505ce2c4 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/table/af3b12b932a24bf48c76b1fc505ce2c4 2023-02-07 19:03:41,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af3b12b932a24bf48c76b1fc505ce2c4 2023-02-07 19:03:41,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/table/af3b12b932a24bf48c76b1fc505ce2c4, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 19:03:41,059 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false 2023-02-07 19:03:41,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 19:03:41,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:41,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:41,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796621004Running coprocessor pre-close hooks at 1675796621004Disabling compacts and flushes for region at 1675796621004Disabling writes for close at 1675796621004Obtaining lock to block concurrent updates at 1675796621004Preparing flush snapshotting stores in 1588230740 at 1675796621004Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675796621004Flushing stores of hbase:meta,,1.1588230740 at 1675796621005 (+1 ms)Flushing 1588230740/info: creating writer at 1675796621005Flushing 1588230740/info: appending metadata at 1675796621007 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675796621007Flushing 1588230740/rep_barrier: creating writer at 1675796621024 (+17 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675796621025 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675796621025Flushing 1588230740/table: creating writer at 1675796621035 (+10 ms)Flushing 1588230740/table: appending metadata at 1675796621037 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796621037Flushing 1588230740/info: reopening flushed file at 1675796621046 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675796621051 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675796621055 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false at 1675796621059 (+4 ms)Writing region close event to WAL at 1675796621061 (+2 ms)Running coprocessor post-close hooks at 1675796621063 (+2 ms)Closed at 1675796621064 (+1 ms) 2023-02-07 19:03:41,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:41,105 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:41,105 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:41,105 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53f3a85f rejected from java.util.concurrent.ThreadPoolExecutor@57cc26f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,106 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:41,105 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46363,1675796618040 2023-02-07 19:03:41,106 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6de9fdb1 rejected from java.util.concurrent.ThreadPoolExecutor@57cc26f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,106 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:41,107 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,46363,1675796618040] 2023-02-07 19:03:41,107 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,46363,1675796618040; numProcessing=1 2023-02-07 19:03:41,108 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,46363,1675796618040 already deleted, retry=false 2023-02-07 19:03:41,108 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,46363,1675796618040 expired; onlineServers=1 2023-02-07 19:03:41,203 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39193,1675796618064; all regions closed. 2023-02-07 19:03:41,209 DEBUG [RS:1;jenkins-hbase6:39193] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/oldWALs 2023-02-07 19:03:41,209 INFO [RS:1;jenkins-hbase6:39193] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39193%2C1675796618064.meta:.meta(num 1675796618657) 2023-02-07 19:03:41,213 DEBUG [RS:1;jenkins-hbase6:39193] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/oldWALs 2023-02-07 19:03:41,213 INFO [RS:1;jenkins-hbase6:39193] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39193%2C1675796618064:(num 1675796619058) 2023-02-07 19:03:41,213 DEBUG [RS:1;jenkins-hbase6:39193] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:41,213 INFO [RS:1;jenkins-hbase6:39193] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:41,213 INFO [RS:1;jenkins-hbase6:39193] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:41,213 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:41,214 INFO [RS:1;jenkins-hbase6:39193] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39193 2023-02-07 19:03:41,216 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39193,1675796618064 2023-02-07 19:03:41,216 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:41,216 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@610dfec4 rejected from java.util.concurrent.ThreadPoolExecutor@6532763d[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,217 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,39193,1675796618064] 2023-02-07 19:03:41,217 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,39193,1675796618064; numProcessing=2 2023-02-07 19:03:41,218 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,39193,1675796618064 already deleted, retry=false 2023-02-07 19:03:41,218 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,39193,1675796618064 expired; onlineServers=0 2023-02-07 19:03:41,218 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,38053,1675796617989' ***** 2023-02-07 19:03:41,218 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:41,219 DEBUG [M:0;jenkins-hbase6:38053] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d5bf589, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:41,219 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,38053,1675796617989 2023-02-07 19:03:41,219 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,38053,1675796617989; all regions closed. 2023-02-07 19:03:41,219 DEBUG [M:0;jenkins-hbase6:38053] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:41,219 DEBUG [M:0;jenkins-hbase6:38053] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:41,219 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:41,219 DEBUG [M:0;jenkins-hbase6:38053] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:41,219 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796618227] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796618227,5,FailOnTimeoutGroup] 2023-02-07 19:03:41,219 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796618227] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796618227,5,FailOnTimeoutGroup] 2023-02-07 19:03:41,219 INFO [M:0;jenkins-hbase6:38053] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:41,220 INFO [M:0;jenkins-hbase6:38053] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:41,220 INFO [M:0;jenkins-hbase6:38053] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:41,220 DEBUG [M:0;jenkins-hbase6:38053] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:41,221 INFO [M:0;jenkins-hbase6:38053] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:41,221 ERROR [M:0;jenkins-hbase6:38053] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 19:03:41,221 INFO [M:0;jenkins-hbase6:38053] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:41,221 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:41,222 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:41,222 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:41,222 DEBUG [M:0;jenkins-hbase6:38053] zookeeper.ZKUtil(398): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:41,222 WARN [M:0;jenkins-hbase6:38053] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:41,222 INFO [M:0;jenkins-hbase6:38053] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:41,223 INFO [M:0;jenkins-hbase6:38053] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:41,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:41,223 DEBUG [M:0;jenkins-hbase6:38053] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:41,223 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:41,223 DEBUG [M:0;jenkins-hbase6:38053] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:41,223 DEBUG [M:0;jenkins-hbase6:38053] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:41,223 DEBUG [M:0;jenkins-hbase6:38053] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:41,223 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.66 KB heapSize=67.62 KB 2023-02-07 19:03:41,233 INFO [M:0;jenkins-hbase6:38053] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7d75182ca0d74bef9261ca5ce4e3d6d0 2023-02-07 19:03:41,237 DEBUG [M:0;jenkins-hbase6:38053] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7d75182ca0d74bef9261ca5ce4e3d6d0 as hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7d75182ca0d74bef9261ca5ce4e3d6d0 2023-02-07 19:03:41,241 INFO [M:0;jenkins-hbase6:38053] regionserver.HStore(1080): Added hdfs://localhost:36609/user/jenkins/test-data/f03f2668-7568-a034-7c3a-852198bd4347/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7d75182ca0d74bef9261ca5ce4e3d6d0, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 19:03:41,241 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegion(2947): Finished flush of dataSize ~56.66 KB/58020, heapSize ~67.60 KB/69224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-07 19:03:41,242 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:41,242 DEBUG [M:0;jenkins-hbase6:38053] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796621223Disabling compacts and flushes for region at 1675796621223Disabling writes for close at 1675796621223Obtaining lock to block concurrent updates at 1675796621223Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796621223Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58020, getHeapSize=69224, getOffHeapSize=0, getCellsCount=145 at 1675796621223Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796621224 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796621224Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796621226 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796621226Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796621237 (+11 ms)Finished flush of dataSize ~56.66 KB/58020, heapSize ~67.60 KB/69224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675796621241 (+4 ms)Writing region close event to WAL at 1675796621242 (+1 ms)Closed at 1675796621242 2023-02-07 19:03:41,244 INFO [M:0;jenkins-hbase6:38053] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:41,244 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:41,244 INFO [M:0;jenkins-hbase6:38053] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:38053 2023-02-07 19:03:41,246 DEBUG [M:0;jenkins-hbase6:38053] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,38053,1675796617989 already deleted, retry=false 2023-02-07 19:03:41,397 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:41,397 INFO [M:0;jenkins-hbase6:38053] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,38053,1675796617989; zookeeper connection closed. 2023-02-07 19:03:41,397 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@719e378e rejected from java.util.concurrent.ThreadPoolExecutor@75a1bd65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,398 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): master:38053-0x1013e984f370000, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:41,398 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17bacca rejected from java.util.concurrent.ThreadPoolExecutor@75a1bd65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,497 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:41,497 INFO [RS:1;jenkins-hbase6:39193] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39193,1675796618064; zookeeper connection closed. 2023-02-07 19:03:41,497 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1fafa5c1 rejected from java.util.concurrent.ThreadPoolExecutor@6532763d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,498 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:39193-0x1013e984f370002, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:41,498 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@672f9ca6 rejected from java.util.concurrent.ThreadPoolExecutor@6532763d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,498 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@867298e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@867298e 2023-02-07 19:03:41,597 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:41,598 INFO [RS:0;jenkins-hbase6:46363] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,46363,1675796618040; zookeeper connection closed. 2023-02-07 19:03:41,598 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@155b1066 rejected from java.util.concurrent.ThreadPoolExecutor@57cc26f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,598 DEBUG [Listener at localhost/34785-EventThread] zookeeper.ZKWatcher(600): regionserver:46363-0x1013e984f370001, quorum=127.0.0.1:58403, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:41,598 ERROR [Listener at localhost/34785-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50c732b3 rejected from java.util.concurrent.ThreadPoolExecutor@57cc26f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:41,598 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5cd7fdcb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5cd7fdcb 2023-02-07 19:03:41,598 INFO [Listener at localhost/34785] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:41,598 WARN [Listener at localhost/34785] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:41,602 INFO [Listener at localhost/34785] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:41,709 WARN [BP-1460678235-172.31.2.20-1675796617311 heartbeating to localhost/127.0.0.1:36609] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:41,709 WARN [BP-1460678235-172.31.2.20-1675796617311 heartbeating to localhost/127.0.0.1:36609] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1460678235-172.31.2.20-1675796617311 (Datanode Uuid ee9e175b-5665-4687-9099-7b6eccc09bd1) service to localhost/127.0.0.1:36609 2023-02-07 19:03:41,710 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/dfs/data/data3/current/BP-1460678235-172.31.2.20-1675796617311] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:41,711 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/dfs/data/data4/current/BP-1460678235-172.31.2.20-1675796617311] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:41,712 WARN [Listener at localhost/34785] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:41,715 INFO [Listener at localhost/34785] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:41,816 WARN [BP-1460678235-172.31.2.20-1675796617311 heartbeating to localhost/127.0.0.1:36609] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:41,816 WARN [BP-1460678235-172.31.2.20-1675796617311 heartbeating to localhost/127.0.0.1:36609] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1460678235-172.31.2.20-1675796617311 (Datanode Uuid a524b8ad-c541-48df-bcb9-4ca582e32c0f) service to localhost/127.0.0.1:36609 2023-02-07 19:03:41,817 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/dfs/data/data1/current/BP-1460678235-172.31.2.20-1675796617311] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:41,817 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/cluster_894f1b2e-e419-8d99-3c27-7118c118fb61/dfs/data/data2/current/BP-1460678235-172.31.2.20-1675796617311] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:41,827 INFO [Listener at localhost/34785] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:41,940 INFO [Listener at localhost/34785] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:41,971 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:41,985 INFO [Listener at localhost/34785] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 255) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:36609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34785 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36609 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:36609 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:36609 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:36609 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,38053,1675796617989)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:36609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:36609 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=570 (was 616), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 340), ProcessCount=169 (was 169), AvailableMemoryMB=4697 (was 4749) 2023-02-07 19:03:41,997 INFO [Listener at localhost/34785] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=570, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=169, AvailableMemoryMB=4696 2023-02-07 19:03:42,007 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/hadoop.log.dir so I do NOT create it in target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4 2023-02-07 19:03:42,007 WARN [Listener at localhost/34785] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 19:03:42,007 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/hadoop.tmp.dir so I do NOT create it in target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4 2023-02-07 19:03:42,007 WARN [Listener at localhost/34785] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8e6d032c-4d34-a1ab-6adc-bd6ee85c0838/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 19:03:42,007 DEBUG [Listener at localhost/34785] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4 2023-02-07 19:03:42,007 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 19:03:42,007 INFO [Listener at localhost/34785] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3, deleteOnExit=true 2023-02-07 19:03:42,007 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/test.cache.data in system properties and HBase conf 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/hadoop.log.dir in system properties and HBase conf 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 19:03:42,008 DEBUG [Listener at localhost/34785] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:42,008 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/nfs.dump.dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/java.io.tmpdir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 19:03:42,009 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 19:03:42,010 INFO [Listener at localhost/34785] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 19:03:42,014 WARN [Listener at localhost/34785] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:42,014 WARN [Listener at localhost/34785] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:42,055 WARN [Listener at localhost/34785] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:42,057 INFO [Listener at localhost/34785] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:42,060 INFO [Listener at localhost/34785] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/java.io.tmpdir/Jetty_localhost_43543_hdfs____cs885b/webapp 2023-02-07 19:03:42,152 INFO [Listener at localhost/34785] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43543 2023-02-07 19:03:42,199 WARN [Listener at localhost/34785] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 19:03:42,201 WARN [Listener at localhost/34785] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 19:03:42,238 WARN [Listener at localhost/43805] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:42,252 WARN [Listener at localhost/43805] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:42,254 WARN [Listener at localhost/43805] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:42,256 INFO [Listener at localhost/43805] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:42,262 INFO [Listener at localhost/43805] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/java.io.tmpdir/Jetty_localhost_38643_datanode____osxn6f/webapp 2023-02-07 19:03:42,359 INFO [Listener at localhost/43805] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38643 2023-02-07 19:03:42,370 WARN [Listener at localhost/38721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:42,384 WARN [Listener at localhost/38721] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 19:03:42,387 WARN [Listener at localhost/38721] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 19:03:42,388 INFO [Listener at localhost/38721] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 19:03:42,392 INFO [Listener at localhost/38721] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/java.io.tmpdir/Jetty_localhost_46833_datanode____.jrjakj/webapp 2023-02-07 19:03:42,476 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9b69e3f04337285: Processing first storage report for DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05 from datanode 7f34976f-b8c8-4112-b9ba-115ac4356ef7 2023-02-07 19:03:42,476 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9b69e3f04337285: from storage DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05 node DatanodeRegistration(127.0.0.1:45921, datanodeUuid=7f34976f-b8c8-4112-b9ba-115ac4356ef7, infoPort=35193, infoSecurePort=0, ipcPort=38721, storageInfo=lv=-57;cid=testClusterID;nsid=1267897364;c=1675796622016), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:42,476 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9b69e3f04337285: Processing first storage report for DS-fb083250-b120-449c-a462-59d3aed2d202 from datanode 7f34976f-b8c8-4112-b9ba-115ac4356ef7 2023-02-07 19:03:42,476 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9b69e3f04337285: from storage DS-fb083250-b120-449c-a462-59d3aed2d202 node DatanodeRegistration(127.0.0.1:45921, datanodeUuid=7f34976f-b8c8-4112-b9ba-115ac4356ef7, infoPort=35193, infoSecurePort=0, ipcPort=38721, storageInfo=lv=-57;cid=testClusterID;nsid=1267897364;c=1675796622016), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:42,510 INFO [Listener at localhost/38721] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46833 2023-02-07 19:03:42,522 WARN [Listener at localhost/35645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 19:03:42,618 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x809a17554bba1589: Processing first storage report for DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8 from datanode 9b17bed6-ebdb-4918-93fd-f28528a120d5 2023-02-07 19:03:42,618 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x809a17554bba1589: from storage DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8 node DatanodeRegistration(127.0.0.1:44651, datanodeUuid=9b17bed6-ebdb-4918-93fd-f28528a120d5, infoPort=38511, infoSecurePort=0, ipcPort=35645, storageInfo=lv=-57;cid=testClusterID;nsid=1267897364;c=1675796622016), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:42,618 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x809a17554bba1589: Processing first storage report for DS-ab74455f-20bf-41f3-9214-c194b9d94de1 from datanode 9b17bed6-ebdb-4918-93fd-f28528a120d5 2023-02-07 19:03:42,618 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x809a17554bba1589: from storage DS-ab74455f-20bf-41f3-9214-c194b9d94de1 node DatanodeRegistration(127.0.0.1:44651, datanodeUuid=9b17bed6-ebdb-4918-93fd-f28528a120d5, infoPort=38511, infoSecurePort=0, ipcPort=35645, storageInfo=lv=-57;cid=testClusterID;nsid=1267897364;c=1675796622016), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 19:03:42,629 DEBUG [Listener at localhost/35645] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4 2023-02-07 19:03:42,631 INFO [Listener at localhost/35645] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/zookeeper_0, clientPort=61731, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 19:03:42,632 INFO [Listener at localhost/35645] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61731 2023-02-07 19:03:42,632 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,633 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,645 INFO [Listener at localhost/35645] util.FSUtils(479): Created version file at hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294 with version=8 2023-02-07 19:03:42,646 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,647 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,648 INFO [Listener at localhost/35645] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/hbase-staging 2023-02-07 19:03:42,650 INFO [Listener at localhost/35645] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:42,650 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,651 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,651 INFO [Listener at localhost/35645] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:42,651 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,651 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:42,651 INFO [Listener at localhost/35645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:42,652 INFO [Listener at localhost/35645] ipc.NettyRpcServer(120): Bind to /172.31.2.20:45359 2023-02-07 19:03:42,652 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,653 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,654 INFO [Listener at localhost/35645] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45359 connecting to ZooKeeper ensemble=127.0.0.1:61731 2023-02-07 19:03:42,662 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:453590x0, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:42,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45359-0x1013e98616c0000 connected 2023-02-07 19:03:42,686 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:42,686 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:42,687 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:42,690 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45359 2023-02-07 19:03:42,691 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45359 2023-02-07 19:03:42,693 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45359 2023-02-07 19:03:42,694 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45359 2023-02-07 19:03:42,694 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45359 2023-02-07 19:03:42,694 INFO [Listener at localhost/35645] master.HMaster(439): hbase.rootdir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294, hbase.cluster.distributed=false 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:42,708 INFO [Listener at localhost/35645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:42,710 INFO [Listener at localhost/35645] ipc.NettyRpcServer(120): Bind to /172.31.2.20:45543 2023-02-07 19:03:42,711 INFO [Listener at localhost/35645] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:42,711 DEBUG [Listener at localhost/35645] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:42,712 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,713 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,713 INFO [Listener at localhost/35645] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45543 connecting to ZooKeeper ensemble=127.0.0.1:61731 2023-02-07 19:03:42,716 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:455430x0, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:42,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45543-0x1013e98616c0001 connected 2023-02-07 19:03:42,718 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:42,719 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:42,719 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:42,720 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45543 2023-02-07 19:03:42,720 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45543 2023-02-07 19:03:42,721 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45543 2023-02-07 19:03:42,721 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45543 2023-02-07 19:03:42,722 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45543 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 19:03:42,733 INFO [Listener at localhost/35645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 19:03:42,734 INFO [Listener at localhost/35645] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44643 2023-02-07 19:03:42,734 INFO [Listener at localhost/35645] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 19:03:42,735 DEBUG [Listener at localhost/35645] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:42,735 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,736 INFO [Listener at localhost/35645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,737 INFO [Listener at localhost/35645] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44643 connecting to ZooKeeper ensemble=127.0.0.1:61731 2023-02-07 19:03:42,740 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:446430x0, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 19:03:42,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44643-0x1013e98616c0002 connected 2023-02-07 19:03:42,741 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:42,742 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:42,742 DEBUG [Listener at localhost/35645] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 19:03:42,744 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44643 2023-02-07 19:03:42,746 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44643 2023-02-07 19:03:42,746 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44643 2023-02-07 19:03:42,747 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44643 2023-02-07 19:03:42,747 DEBUG [Listener at localhost/35645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44643 2023-02-07 19:03:42,752 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,754 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:42,754 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,755 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:42,755 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:42,755 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:42,757 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:42,758 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:42,760 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,45359,1675796622650 from backup master directory 2023-02-07 19:03:42,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 19:03:42,761 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,761 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 19:03:42,761 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:42,761 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,774 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/hbase.id with ID: 2fb36282-8811-463a-97bc-15900d5e927c 2023-02-07 19:03:42,785 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 19:03:42,788 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:42,795 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x246ad453 to 127.0.0.1:61731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:42,798 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@456a1835, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:42,798 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:42,799 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 19:03:42,799 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:42,800 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store-tmp 2023-02-07 19:03:42,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:42,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:42,809 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:42,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:42,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:42,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:42,809 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:42,809 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796622809Disabling compacts and flushes for region at 1675796622809Disabling writes for close at 1675796622809Writing region close event to WAL at 1675796622809Closed at 1675796622809 2023-02-07 19:03:42,810 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/WALs/jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,811 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C45359%2C1675796622650, suffix=, logDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/WALs/jenkins-hbase6.apache.org,45359,1675796622650, archiveDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/oldWALs, maxLogs=10 2023-02-07 19:03:42,824 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK] 2023-02-07 19:03:42,824 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK] 2023-02-07 19:03:42,826 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/WALs/jenkins-hbase6.apache.org,45359,1675796622650/jenkins-hbase6.apache.org%2C45359%2C1675796622650.1675796622812 2023-02-07 19:03:42,827 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK], DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK]] 2023-02-07 19:03:42,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:42,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:42,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:42,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:42,830 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:42,831 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 19:03:42,831 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 19:03:42,831 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:42,832 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:42,832 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:42,834 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 19:03:42,837 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:42,838 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66803841, jitterRate=-0.004545196890830994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:42,838 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675796622828Initializing all the Stores at 1675796622829 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796622829Cleaning up temporary data from old regions at 1675796622832 (+3 ms)Cleaning up detritus from prior splits at 1675796622832Region opened successfully at 1675796622838 (+6 ms) 2023-02-07 19:03:42,838 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 19:03:42,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 19:03:42,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 19:03:42,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 19:03:42,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 19:03:42,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 19:03:42,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 19:03:42,844 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 19:03:42,844 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 19:03:42,854 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 19:03:42,854 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 19:03:42,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 19:03:42,855 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 19:03:42,855 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 19:03:42,857 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:42,857 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 19:03:42,857 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 19:03:42,858 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 19:03:42,859 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:42,859 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:42,859 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:42,859 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:42,860 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,45359,1675796622650, sessionid=0x1013e98616c0000, setting cluster-up flag (Was=false) 2023-02-07 19:03:42,865 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:42,869 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 19:03:42,869 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,874 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:42,881 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 19:03:42,882 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:42,882 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.hbase-snapshot/.tmp 2023-02-07 19:03:42,883 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:42,884 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675796652886 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 19:03:42,886 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:42,886 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,886 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 19:03:42,887 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 19:03:42,887 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 19:03:42,887 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 19:03:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 19:03:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 19:03:42,888 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796622888,5,FailOnTimeoutGroup] 2023-02-07 19:03:42,888 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796622888,5,FailOnTimeoutGroup] 2023-02-07 19:03:42,888 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 19:03:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,898 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:42,898 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:42,898 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294 2023-02-07 19:03:42,904 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:42,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:42,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/info 2023-02-07 19:03:42,907 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:42,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:42,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:42,908 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:42,908 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:42,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:42,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:42,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/table 2023-02-07 19:03:42,910 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:42,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:42,911 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740 2023-02-07 19:03:42,911 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740 2023-02-07 19:03:42,912 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:42,913 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:42,915 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73842715, jitterRate=0.10034219920635223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675796622904Initializing all the Stores at 1675796622905 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796622905Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796622905Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796622905Cleaning up temporary data from old regions at 1675796622912 (+7 ms)Cleaning up detritus from prior splits at 1675796622912Region opened successfully at 1675796622915 (+3 ms) 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:42,915 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:42,915 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:42,915 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796622915Disabling compacts and flushes for region at 1675796622915Disabling writes for close at 1675796622915Writing region close event to WAL at 1675796622915Closed at 1675796622915 2023-02-07 19:03:42,916 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 19:03:42,916 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 19:03:42,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 19:03:42,918 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 19:03:42,919 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 19:03:42,952 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(952): ClusterId : 2fb36282-8811-463a-97bc-15900d5e927c 2023-02-07 19:03:42,952 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(952): ClusterId : 2fb36282-8811-463a-97bc-15900d5e927c 2023-02-07 19:03:42,952 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:42,952 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 19:03:42,955 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:42,955 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:42,955 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 19:03:42,955 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 19:03:42,958 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:42,959 DEBUG [RS:0;jenkins-hbase6:45543] zookeeper.ReadOnlyZKClient(139): Connect 0x34501ccd to 127.0.0.1:61731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:42,959 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 19:03:42,960 DEBUG [RS:1;jenkins-hbase6:44643] zookeeper.ReadOnlyZKClient(139): Connect 0x4595abc5 to 127.0.0.1:61731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:42,963 DEBUG [RS:0;jenkins-hbase6:45543] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a97f437, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:42,963 DEBUG [RS:0;jenkins-hbase6:45543] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ea877bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:42,965 DEBUG [RS:1;jenkins-hbase6:44643] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b524d07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:42,965 DEBUG [RS:1;jenkins-hbase6:44643] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f6dc0b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:42,972 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:45543 2023-02-07 19:03:42,972 INFO [RS:0;jenkins-hbase6:45543] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:42,972 INFO [RS:0;jenkins-hbase6:45543] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:42,972 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:42,973 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,45359,1675796622650 with isa=jenkins-hbase6.apache.org/172.31.2.20:45543, startcode=1675796622708 2023-02-07 19:03:42,973 DEBUG [RS:0;jenkins-hbase6:45543] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:42,974 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38981, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:42,974 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:44643 2023-02-07 19:03:42,974 INFO [RS:1;jenkins-hbase6:44643] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 19:03:42,974 INFO [RS:1;jenkins-hbase6:44643] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 19:03:42,974 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 19:03:42,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:42,976 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,45359,1675796622650 with isa=jenkins-hbase6.apache.org/172.31.2.20:44643, startcode=1675796622732 2023-02-07 19:03:42,976 DEBUG [RS:1;jenkins-hbase6:44643] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 19:03:42,976 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294 2023-02-07 19:03:42,976 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43805 2023-02-07 19:03:42,976 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:42,977 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48549, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 19:03:42,978 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:42,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:42,978 DEBUG [RS:0;jenkins-hbase6:45543] zookeeper.ZKUtil(162): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:42,979 WARN [RS:0;jenkins-hbase6:45543] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:42,979 INFO [RS:0;jenkins-hbase6:45543] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:42,979 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294 2023-02-07 19:03:42,979 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:42,979 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,45543,1675796622708] 2023-02-07 19:03:42,979 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43805 2023-02-07 19:03:42,979 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 19:03:42,984 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:42,984 DEBUG [RS:1;jenkins-hbase6:44643] zookeeper.ZKUtil(162): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:42,984 WARN [RS:1;jenkins-hbase6:44643] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 19:03:42,984 INFO [RS:1;jenkins-hbase6:44643] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:42,984 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44643,1675796622732] 2023-02-07 19:03:42,984 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:42,984 DEBUG [RS:0;jenkins-hbase6:45543] zookeeper.ZKUtil(162): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:42,985 DEBUG [RS:0;jenkins-hbase6:45543] zookeeper.ZKUtil(162): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:42,986 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:42,987 INFO [RS:0;jenkins-hbase6:45543] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:42,987 DEBUG [RS:1;jenkins-hbase6:44643] zookeeper.ZKUtil(162): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:42,988 DEBUG [RS:1;jenkins-hbase6:44643] zookeeper.ZKUtil(162): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:42,988 INFO [RS:0;jenkins-hbase6:45543] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:42,988 INFO [RS:0;jenkins-hbase6:45543] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:42,988 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,988 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:42,990 DEBUG [RS:1;jenkins-hbase6:44643] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 19:03:42,990 INFO [RS:1;jenkins-hbase6:44643] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 19:03:42,992 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,992 DEBUG [RS:0;jenkins-hbase6:45543] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:42,995 INFO [RS:1;jenkins-hbase6:44643] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 19:03:42,997 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,997 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,997 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,997 INFO [RS:1;jenkins-hbase6:44643] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 19:03:42,997 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:42,998 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 19:03:42,999 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,001 DEBUG [RS:1;jenkins-hbase6:44643] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-07 19:03:43,004 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,004 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,004 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,010 INFO [RS:0;jenkins-hbase6:45543] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:43,010 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,45543,1675796622708-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,014 INFO [RS:1;jenkins-hbase6:44643] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 19:03:43,014 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44643,1675796622732-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,023 INFO [RS:0;jenkins-hbase6:45543] regionserver.Replication(203): jenkins-hbase6.apache.org,45543,1675796622708 started 2023-02-07 19:03:43,023 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,45543,1675796622708, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:45543, sessionid=0x1013e98616c0001 2023-02-07 19:03:43,023 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:43,023 DEBUG [RS:0;jenkins-hbase6:45543] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:43,023 DEBUG [RS:0;jenkins-hbase6:45543] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,45543,1675796622708' 2023-02-07 19:03:43,023 DEBUG [RS:0;jenkins-hbase6:45543] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:43,023 DEBUG [RS:0;jenkins-hbase6:45543] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,45543,1675796622708' 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:43,024 DEBUG [RS:0;jenkins-hbase6:45543] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:43,024 INFO [RS:0;jenkins-hbase6:45543] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:43,024 INFO [RS:0;jenkins-hbase6:45543] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:43,026 INFO [RS:1;jenkins-hbase6:44643] regionserver.Replication(203): jenkins-hbase6.apache.org,44643,1675796622732 started 2023-02-07 19:03:43,026 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,44643,1675796622732, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44643, sessionid=0x1013e98616c0002 2023-02-07 19:03:43,026 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 19:03:43,026 DEBUG [RS:1;jenkins-hbase6:44643] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:43,026 DEBUG [RS:1;jenkins-hbase6:44643] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44643,1675796622732' 2023-02-07 19:03:43,026 DEBUG [RS:1;jenkins-hbase6:44643] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44643,1675796622732' 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:43,027 DEBUG [RS:1;jenkins-hbase6:44643] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 19:03:43,027 INFO [RS:1;jenkins-hbase6:44643] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 19:03:43,028 INFO [RS:1;jenkins-hbase6:44643] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 19:03:43,069 DEBUG [jenkins-hbase6:45359] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 19:03:43,069 DEBUG [jenkins-hbase6:45359] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:43,071 DEBUG [jenkins-hbase6:45359] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:43,071 DEBUG [jenkins-hbase6:45359] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:43,071 DEBUG [jenkins-hbase6:45359] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:43,071 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,45543,1675796622708, state=OPENING 2023-02-07 19:03:43,072 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 19:03:43,074 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:43,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,45543,1675796622708}] 2023-02-07 19:03:43,074 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:43,229 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:43,229 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 19:03:43,231 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 19:03:43,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 19:03:43,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 19:03:43,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C45543%2C1675796622708.meta, suffix=.meta, logDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,45543,1675796622708, archiveDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/oldWALs, maxLogs=32 2023-02-07 19:03:43,255 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK] 2023-02-07 19:03:43,255 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK] 2023-02-07 19:03:43,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,45543,1675796622708/jenkins-hbase6.apache.org%2C45543%2C1675796622708.meta.1675796623235.meta 2023-02-07 19:03:43,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK]] 2023-02-07 19:03:43,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:43,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 19:03:43,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 19:03:43,258 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 19:03:43,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 19:03:43,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:43,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 19:03:43,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 19:03:43,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 19:03:43,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/info 2023-02-07 19:03:43,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/info 2023-02-07 19:03:43,260 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 19:03:43,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:43,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 19:03:43,261 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:43,261 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/rep_barrier 2023-02-07 19:03:43,262 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 19:03:43,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:43,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 19:03:43,263 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/table 2023-02-07 19:03:43,263 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/table 2023-02-07 19:03:43,263 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 19:03:43,264 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:43,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740 2023-02-07 19:03:43,265 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740 2023-02-07 19:03:43,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 19:03:43,267 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 19:03:43,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60132897, jitterRate=-0.10395000874996185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 19:03:43,267 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675796623258Writing region info on filesystem at 1675796623258Initializing all the Stores at 1675796623259 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796623259Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796623259Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796623259Cleaning up temporary data from old regions at 1675796623265 (+6 ms)Cleaning up detritus from prior splits at 1675796623266 (+1 ms)Running coprocessor post-open hooks at 1675796623267 (+1 ms)Region opened successfully at 1675796623267 2023-02-07 19:03:43,268 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675796623229 2023-02-07 19:03:43,271 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 19:03:43,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 19:03:43,272 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,45543,1675796622708, state=OPEN 2023-02-07 19:03:43,274 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 19:03:43,274 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 19:03:43,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 19:03:43,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,45543,1675796622708 in 200 msec 2023-02-07 19:03:43,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 19:03:43,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-07 19:03:43,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 393 msec 2023-02-07 19:03:43,277 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675796622754, completionTime=-1 2023-02-07 19:03:43,277 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 19:03:43,277 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 19:03:43,280 DEBUG [hconnection-0x31eab926-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:43,281 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:43,282 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 19:03:43,282 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675796683282 2023-02-07 19:03:43,282 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675796743282 2023-02-07 19:03:43,282 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,45359,1675796622650-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,45359,1675796622650-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,45359,1675796622650-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:45359, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 19:03:43,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:43,289 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 19:03:43,291 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 19:03:43,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:43,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:43,296 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,296 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7 empty. 2023-02-07 19:03:43,297 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,297 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 19:03:43,309 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:43,310 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1ebce3de244d95bb80bebb0122d4acc7, NAME => 'hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp 2023-02-07 19:03:43,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:43,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 1ebce3de244d95bb80bebb0122d4acc7, disabling compactions & flushes 2023-02-07 19:03:43,319 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. after waiting 0 ms 2023-02-07 19:03:43,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,319 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 1ebce3de244d95bb80bebb0122d4acc7: Waiting for close lock at 1675796623319Disabling compacts and flushes for region at 1675796623319Disabling writes for close at 1675796623319Writing region close event to WAL at 1675796623319Closed at 1675796623319 2023-02-07 19:03:43,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:43,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796623321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796623321"}]},"ts":"1675796623321"} 2023-02-07 19:03:43,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:43,323 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:43,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796623323"}]},"ts":"1675796623323"} 2023-02-07 19:03:43,324 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 19:03:43,327 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:43,328 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:43,328 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:43,328 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:43,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1ebce3de244d95bb80bebb0122d4acc7, ASSIGN}] 2023-02-07 19:03:43,333 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1ebce3de244d95bb80bebb0122d4acc7, ASSIGN 2023-02-07 19:03:43,333 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1ebce3de244d95bb80bebb0122d4acc7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,45543,1675796622708; forceNewPlan=false, retain=false 2023-02-07 19:03:43,483 INFO [jenkins-hbase6:45359] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:43,484 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1ebce3de244d95bb80bebb0122d4acc7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:43,484 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796623484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796623484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796623484"}]},"ts":"1675796623484"} 2023-02-07 19:03:43,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1ebce3de244d95bb80bebb0122d4acc7, server=jenkins-hbase6.apache.org,45543,1675796622708}] 2023-02-07 19:03:43,640 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,641 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C45543%2C1675796622708, suffix=, logDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,45543,1675796622708, archiveDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/oldWALs, maxLogs=32 2023-02-07 19:03:43,655 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK] 2023-02-07 19:03:43,655 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK] 2023-02-07 19:03:43,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,45543,1675796622708/jenkins-hbase6.apache.org%2C45543%2C1675796622708.1675796623642 2023-02-07 19:03:43,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK], DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK]] 2023-02-07 19:03:43,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ebce3de244d95bb80bebb0122d4acc7, NAME => 'hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:43,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:43,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,658 INFO [StoreOpener-1ebce3de244d95bb80bebb0122d4acc7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,659 DEBUG [StoreOpener-1ebce3de244d95bb80bebb0122d4acc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/info 2023-02-07 19:03:43,659 DEBUG [StoreOpener-1ebce3de244d95bb80bebb0122d4acc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/info 2023-02-07 19:03:43,659 INFO [StoreOpener-1ebce3de244d95bb80bebb0122d4acc7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ebce3de244d95bb80bebb0122d4acc7 columnFamilyName info 2023-02-07 19:03:43,660 INFO [StoreOpener-1ebce3de244d95bb80bebb0122d4acc7-1] regionserver.HStore(310): Store=1ebce3de244d95bb80bebb0122d4acc7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:43,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:43,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:43,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1ebce3de244d95bb80bebb0122d4acc7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74425513, jitterRate=0.10902656614780426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 19:03:43,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1ebce3de244d95bb80bebb0122d4acc7: Running coprocessor pre-open hook at 1675796623657Writing region info on filesystem at 1675796623657Initializing all the Stores at 1675796623658 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675796623658Cleaning up temporary data from old regions at 1675796623661 (+3 ms)Cleaning up detritus from prior splits at 1675796623661Running coprocessor post-open hooks at 1675796623664 (+3 ms)Region opened successfully at 1675796623664 2023-02-07 19:03:43,665 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7., pid=6, masterSystemTime=1675796623637 2023-02-07 19:03:43,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:43,666 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1ebce3de244d95bb80bebb0122d4acc7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:43,667 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675796623666"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796623666"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796623666"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796623666"}]},"ts":"1675796623666"} 2023-02-07 19:03:43,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 19:03:43,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1ebce3de244d95bb80bebb0122d4acc7, server=jenkins-hbase6.apache.org,45543,1675796622708 in 183 msec 2023-02-07 19:03:43,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 19:03:43,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1ebce3de244d95bb80bebb0122d4acc7, ASSIGN in 341 msec 2023-02-07 19:03:43,671 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:43,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796623671"}]},"ts":"1675796623671"} 2023-02-07 19:03:43,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 19:03:43,674 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:43,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-07 19:03:43,692 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 19:03:43,694 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:43,694 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:43,697 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 19:03:43,703 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:43,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-07 19:03:43,718 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 19:03:43,724 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 19:03:43,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 19:03:43,733 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 19:03:43,735 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 19:03:43,735 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.974sec 2023-02-07 19:03:43,736 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 19:03:43,736 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 19:03:43,736 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 19:03:43,736 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,45359,1675796622650-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 19:03:43,736 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,45359,1675796622650-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 19:03:43,737 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 19:03:43,754 DEBUG [Listener at localhost/35645] zookeeper.ReadOnlyZKClient(139): Connect 0x16dff0d5 to 127.0.0.1:61731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:43,757 DEBUG [Listener at localhost/35645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f239498, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:43,759 DEBUG [hconnection-0x5226f474-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:43,760 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51132, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:43,761 INFO [Listener at localhost/35645] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:43,761 DEBUG [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 19:03:43,761 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:43,761 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:43,764 DEBUG [Listener at localhost/35645] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 19:03:43,765 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44496, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 19:03:43,766 INFO [Listener at localhost/35645] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 19:03:43,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-07 19:03:43,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 19:03:43,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.2.20:44496 deadline: 1675796683766, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 19:03:43,766 INFO [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 19:03:43,767 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:43,767 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:43,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 19:03:43,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 19:03:43,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 19:03:43,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 19:03:43,771 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:43,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 19:03:43,771 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:43,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:43,773 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:43,773 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 empty. 2023-02-07 19:03:43,773 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:43,773 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 19:03:43,781 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 19:03:43,782 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc117f90ab205091051ef7bca51e1532, NAME => 'testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp 2023-02-07 19:03:43,787 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:43,787 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fc117f90ab205091051ef7bca51e1532, disabling compactions & flushes 2023-02-07 19:03:43,787 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:43,787 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:43,788 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. after waiting 0 ms 2023-02-07 19:03:43,788 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:43,788 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:43,788 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fc117f90ab205091051ef7bca51e1532: Waiting for close lock at 1675796623787Disabling compacts and flushes for region at 1675796623787Disabling writes for close at 1675796623788 (+1 ms)Writing region close event to WAL at 1675796623788Closed at 1675796623788 2023-02-07 19:03:43,789 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 19:03:43,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675796623790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796623790"}]},"ts":"1675796623790"} 2023-02-07 19:03:43,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 19:03:43,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 19:03:43,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796623792"}]},"ts":"1675796623792"} 2023-02-07 19:03:43,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 19:03:43,797 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-07 19:03:43,798 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 19:03:43,798 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 19:03:43,798 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 19:03:43,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, ASSIGN}] 2023-02-07 19:03:43,798 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, ASSIGN 2023-02-07 19:03:43,799 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,45543,1675796622708; forceNewPlan=false, retain=false 2023-02-07 19:03:43,872 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:43,872 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:43,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:43,949 INFO [jenkins-hbase6:45359] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 19:03:43,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fc117f90ab205091051ef7bca51e1532, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:43,950 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675796623949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796623949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796623949"}]},"ts":"1675796623949"} 2023-02-07 19:03:43,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure fc117f90ab205091051ef7bca51e1532, server=jenkins-hbase6.apache.org,45543,1675796622708}] 2023-02-07 19:03:44,029 INFO [RS:1;jenkins-hbase6:44643] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44643%2C1675796622732, suffix=, logDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,44643,1675796622732, archiveDir=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/oldWALs, maxLogs=32 2023-02-07 19:03:44,044 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK] 2023-02-07 19:03:44,044 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK] 2023-02-07 19:03:44,045 INFO [RS:1;jenkins-hbase6:44643] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/WALs/jenkins-hbase6.apache.org,44643,1675796622732/jenkins-hbase6.apache.org%2C44643%2C1675796622732.1675796624029 2023-02-07 19:03:44,045 DEBUG [RS:1;jenkins-hbase6:44643] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45921,DS-7e2e9373-b6fe-4c1d-8755-4b548b838a05,DISK], DatanodeInfoWithStorage[127.0.0.1:44651,DS-7b382eaa-0f91-4bcf-9464-e475b0b8e5b8,DISK]] 2023-02-07 19:03:44,074 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,074 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:44,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc117f90ab205091051ef7bca51e1532, NAME => 'testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.', STARTKEY => '', ENDKEY => ''} 2023-02-07 19:03:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,107 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,108 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1 2023-02-07 19:03:44,108 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1 2023-02-07 19:03:44,109 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc117f90ab205091051ef7bca51e1532 columnFamilyName f1 2023-02-07 19:03:44,109 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(310): Store=fc117f90ab205091051ef7bca51e1532/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:44,109 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,110 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2 2023-02-07 19:03:44,110 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2 2023-02-07 19:03:44,111 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc117f90ab205091051ef7bca51e1532 columnFamilyName f2 2023-02-07 19:03:44,111 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(310): Store=fc117f90ab205091051ef7bca51e1532/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:44,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:44,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 19:03:44,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened fc117f90ab205091051ef7bca51e1532; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59005304, jitterRate=-0.12075245380401611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:44,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for fc117f90ab205091051ef7bca51e1532: Running coprocessor pre-open hook at 1675796624106Writing region info on filesystem at 1675796624106Initializing all the Stores at 1675796624107 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796624107Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796624107Cleaning up temporary data from old regions at 1675796624112 (+5 ms)Cleaning up detritus from prior splits at 1675796624113 (+1 ms)Running coprocessor post-open hooks at 1675796624116 (+3 ms)Region opened successfully at 1675796624116 2023-02-07 19:03:44,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532., pid=12, masterSystemTime=1675796624103 2023-02-07 19:03:44,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,118 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fc117f90ab205091051ef7bca51e1532, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,118 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675796624118"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675796624118"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675796624118"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675796624118"}]},"ts":"1675796624118"} 2023-02-07 19:03:44,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 19:03:44,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure fc117f90ab205091051ef7bca51e1532, server=jenkins-hbase6.apache.org,45543,1675796622708 in 169 msec 2023-02-07 19:03:44,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 19:03:44,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, ASSIGN in 323 msec 2023-02-07 19:03:44,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 19:03:44,123 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796624122"}]},"ts":"1675796624122"} 2023-02-07 19:03:44,124 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 19:03:44,126 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 19:03:44,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 357 msec 2023-02-07 19:03:44,376 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,376 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 19:03:44,377 INFO [Listener at localhost/35645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 19:03:44,377 DEBUG [Listener at localhost/35645] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 19:03:44,377 INFO [Listener at localhost/35645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:44,379 INFO [Listener at localhost/35645] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 19:03:44,380 INFO [Listener at localhost/35645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 19:03:44,380 INFO [Listener at localhost/35645] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 19:03:44,380 INFO [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 19:03:44,412 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45543] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,489 INFO [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 19:03:44,490 INFO [Listener at localhost/35645] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 19:03:44,490 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,490 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:03:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675796624491 (current time:1675796624491). 2023-02-07 19:03:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 19:03:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] zookeeper.ReadOnlyZKClient(139): Connect 0x419ea7a3 to 127.0.0.1:61731 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 19:03:44,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@405b0730, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 19:03:44,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 19:03:44,497 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51150, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 19:03:44,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x419ea7a3 to 127.0.0.1:61731 2023-02-07 19:03:44,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:44,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 19:03:44,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:03:44,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:03:44,501 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:03:44,501 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675797224501 2023-02-07 19:03:44,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 19:03:44,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 19:03:44,503 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 19:03:44,503 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:44,503 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 19:03:44,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:44,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-07 19:03:44,505 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:44,505 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675797224505 2023-02-07 19:03:44,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-07 19:03:44,513 INFO [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-07 19:03:44,513 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:44,514 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-07 19:03:44,514 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 19:03:44,514 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,514 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,515 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:44,515 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:44,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:44,515 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:44,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:44,516 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,516 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-07 19:03:44,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-07 19:03:44,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-07 19:03:44,520 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-07 19:03:44,520 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:44,521 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 19:03:44,521 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-07 19:03:44,521 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44643,1675796622732' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-07 19:03:44,521 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-07 19:03:44,521 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 19:03:44,524 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 19:03:44,524 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-07 19:03:44,524 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,45543,1675796622708' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-07 19:03:44,525 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,526 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,526 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,526 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:44,526 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,526 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,526 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 19:03:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:44,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,45543,1675796622708' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-07 19:03:44,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d5b13e1[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:44,528 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 19:03:44,528 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,530 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,530 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,531 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 19:03:44,531 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 19:03:44,531 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-07 19:03:44,531 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,44643,1675796622732' in zk 2023-02-07 19:03:44,531 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,531 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:44,531 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 19:03:44,531 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 19:03:44,531 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,531 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. started... 2023-02-07 19:03:44,531 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fc117f90ab205091051ef7bca51e1532 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 19:03:44,532 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-07 19:03:44,532 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:44,532 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-07 19:03:44,544 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f1/07ae1e4bcfb744a5b109379bfcce7414 2023-02-07 19:03:44,563 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f2/139982e079494274987679a0c596e07c 2023-02-07 19:03:44,567 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f1/07ae1e4bcfb744a5b109379bfcce7414 as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/07ae1e4bcfb744a5b109379bfcce7414 2023-02-07 19:03:44,570 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/07ae1e4bcfb744a5b109379bfcce7414, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:44,570 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f2/139982e079494274987679a0c596e07c as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/139982e079494274987679a0c596e07c 2023-02-07 19:03:44,574 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/139982e079494274987679a0c596e07c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 19:03:44,574 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for fc117f90ab205091051ef7bca51e1532 in 43ms, sequenceid=5, compaction requested=false 2023-02-07 19:03:44,574 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fc117f90ab205091051ef7bca51e1532: 2023-02-07 19:03:44,575 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-07 19:03:44,575 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 19:03:44,575 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/07ae1e4bcfb744a5b109379bfcce7414] hfiles 2023-02-07 19:03:44,575 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/07ae1e4bcfb744a5b109379bfcce7414 for snapshot=testWithMapReduceSingleRegion 2023-02-07 19:03:44,575 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/139982e079494274987679a0c596e07c] hfiles 2023-02-07 19:03:44,575 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/139982e079494274987679a0c596e07c for snapshot=testWithMapReduceSingleRegion 2023-02-07 19:03:44,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 19:03:44,587 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. completed. 2023-02-07 19:03:44,587 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,587 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 19:03:44,587 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 19:03:44,587 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,587 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-07 19:03:44,587 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,45543,1675796622708' in zk 2023-02-07 19:03:44,589 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,589 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-07 19:03:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:44,589 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:44,589 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-07 19:03:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 19:03:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 19:03:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase6.apache.org,45543,1675796622708': 2023-02-07 19:03:44,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,45543,1675796622708' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 19:03:44,594 INFO [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-07 19:03:44,594 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:44,594 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:44,594 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-07 19:03:44,594 INFO [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 19:03:44,596 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:44,596 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 19:03:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,596 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:44,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:44,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:44,597 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 19:03:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 19:03:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,599 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:44,599 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 19:03:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,603 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:44,603 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,603 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:44,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 19:03:44,604 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:44,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-07 19:03:44,613 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 19:03:44,614 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 19:03:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 19:03:44,613 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 19:03:44,614 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:44,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-07 19:03:44,614 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,614 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,614 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 19:03:44,614 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 19:03:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 19:03:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 19:03:44,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 19:03:44,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-07 19:03:44,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-07 19:03:44,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 19:03:44,680 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 19:03:44,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675796624502Consolidate snapshot: testWithMapReduceSingleRegion at 1675796624613 (+111 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675796624614 (+1 ms)Writing data manifest for testWithMapReduceSingleRegion at 1675796624618 (+4 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675796624640 (+22 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675796624680 (+40 ms) 2023-02-07 19:03:44,681 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 19:03:44,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 178 msec 2023-02-07 19:03:44,805 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 19:03:44,805 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,805 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 19:03:44,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 19:03:44,806 INFO [Listener at localhost/35645] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 19:03:44,806 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,806 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,810 INFO [Listener at localhost/35645] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 19:03:44,815 INFO [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 19:03:44,847 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45543] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,924 INFO [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 19:03:44,927 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:44,927 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:44,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-07 19:03:44,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 19:03:44,930 INFO [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 19:03:44,931 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:44,931 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 19:03:44,931 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 19:03:44,931 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:44,931 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:44,932 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:44,932 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:44,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:44,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:44,932 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:44,933 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,933 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 19:03:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:44,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:44,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 19:03:44,934 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 19:03:44,934 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:44,934 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 19:03:44,934 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 19:03:44,934 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 19:03:44,934 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 19:03:44,935 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 19:03:44,935 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44643,1675796622732' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 19:03:44,936 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:44,936 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:44,936 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:44,938 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 19:03:44,938 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 19:03:44,938 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,938 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. started... 2023-02-07 19:03:44,938 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fc117f90ab205091051ef7bca51e1532 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 19:03:44,954 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f1/4e27a907a05d4352a702f872e25bb982 2023-02-07 19:03:44,980 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f2/60969174974c4fe3ab9e1c388051e0bb 2023-02-07 19:03:44,984 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f1/4e27a907a05d4352a702f872e25bb982 as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/4e27a907a05d4352a702f872e25bb982 2023-02-07 19:03:44,988 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/4e27a907a05d4352a702f872e25bb982, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:44,989 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/.tmp/f2/60969174974c4fe3ab9e1c388051e0bb as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/60969174974c4fe3ab9e1c388051e0bb 2023-02-07 19:03:44,994 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/60969174974c4fe3ab9e1c388051e0bb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 19:03:44,994 INFO [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for fc117f90ab205091051ef7bca51e1532 in 56ms, sequenceid=9, compaction requested=false 2023-02-07 19:03:44,994 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fc117f90ab205091051ef7bca51e1532: 2023-02-07 19:03:44,994 DEBUG [rs(jenkins-hbase6.apache.org,45543,1675796622708)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:44,994 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 19:03:44,995 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 19:03:44,995 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,995 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 19:03:44,995 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,45543,1675796622708' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 19:03:44,996 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,996 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:44,997 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:44,997 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 19:03:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:44,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,45543,1675796622708' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 19:03:44,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79649892[Count = 0] remaining members to acquire global barrier 2023-02-07 19:03:44,999 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 19:03:44,999 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,001 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 19:03:45,001 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 19:03:45,001 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,001 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 19:03:45,001 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 19:03:45,001 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 19:03:45,001 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,45543,1675796622708' in zk 2023-02-07 19:03:45,001 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,44643,1675796622732' in zk 2023-02-07 19:03:45,003 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,003 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 19:03:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:45,003 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:45,003 DEBUG [member: 'jenkins-hbase6.apache.org,45543,1675796622708' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 19:03:45,004 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 19:03:45,004 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:45,004 DEBUG [member: 'jenkins-hbase6.apache.org,44643,1675796622732' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 19:03:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,45543,1675796622708': 2023-02-07 19:03:45,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,45543,1675796622708' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 19:03:45,007 INFO [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 19:03:45,007 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 19:03:45,007 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 19:03:45,007 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 19:03:45,007 INFO [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 19:03:45,009 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:45,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:45,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 19:03:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 19:03:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 19:03:45,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:45,010 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:45,010 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 19:03:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,012 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 19:03:45,012 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 19:03:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 19:03:45,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:45,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:45,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 19:03:45,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 19:03:45,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 19:03:45,016 DEBUG [(jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 19:03:45,016 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 19:03:45,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 19:03:45,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 19:03:45,017 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 19:03:45,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 19:03:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 19:03:45,117 DEBUG [Listener at localhost/35645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 19:03:45,117 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:45,117 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:45,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 19:03:45,209 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/hadoop-5763463693658426086.jar 2023-02-07 19:03:45,212 INFO [Listener at localhost/35645] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675796624491 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:45,213 DEBUG [Listener at localhost/35645] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c/data/default/testWithMapReduce 2023-02-07 19:03:45,213 INFO [Listener at localhost/35645] snapshot.RestoreSnapshotHelper(239): region to add: fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:45,213 INFO [Listener at localhost/35645] snapshot.RestoreSnapshotHelper(585): clone region=fc117f90ab205091051ef7bca51e1532 as fc117f90ab205091051ef7bca51e1532 in snapshot testWithMapReduceSingleRegion 2023-02-07 19:03:45,214 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc117f90ab205091051ef7bca51e1532, NAME => 'testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c 2023-02-07 19:03:45,220 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:45,220 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 07ae1e4bcfb744a5b109379bfcce7414 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-07 19:03:45,222 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 139982e079494274987679a0c596e07c from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-07 19:03:45,223 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing fc117f90ab205091051ef7bca51e1532, disabling compactions & flushes 2023-02-07 19:03:45,224 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,224 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,224 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. after waiting 0 ms 2023-02-07 19:03:45,224 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,224 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,224 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for fc117f90ab205091051ef7bca51e1532: Waiting for close lock at 1675796625223Disabling compacts and flushes for region at 1675796625223Disabling writes for close at 1675796625224 (+1 ms)Writing region close event to WAL at 1675796625224Closed at 1675796625224 2023-02-07 19:03:45,224 INFO [Listener at localhost/35645] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675796624491 type: FLUSH version: 2 ttl: 0 2023-02-07 19:03:45,224 DEBUG [Listener at localhost/35645] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c 2023-02-07 19:03:45,224 DEBUG [Listener at localhost/35645] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c 2023-02-07 19:03:45,224 DEBUG [Listener at localhost/35645] util.CommonFSUtils(699): |-data/ 2023-02-07 19:03:45,225 DEBUG [Listener at localhost/35645] util.CommonFSUtils(699): |----default/ 2023-02-07 19:03:45,225 DEBUG [Listener at localhost/35645] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 19:03:45,225 DEBUG [Listener at localhost/35645] util.CommonFSUtils(699): |----------fc117f90ab205091051ef7bca51e1532/ 2023-02-07 19:03:45,226 DEBUG [Listener at localhost/35645] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 19:03:45,226 DEBUG [Listener at localhost/35645] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 19:03:45,226 DEBUG [Listener at localhost/35645] util.CommonFSUtils(702): |----------------testWithMapReduce=fc117f90ab205091051ef7bca51e1532-07ae1e4bcfb744a5b109379bfcce7414 2023-02-07 19:03:45,226 DEBUG [Listener at localhost/35645] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 19:03:45,226 DEBUG [Listener at localhost/35645] util.CommonFSUtils(702): |----------------testWithMapReduce=fc117f90ab205091051ef7bca51e1532-139982e079494274987679a0c596e07c 2023-02-07 19:03:45,227 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,227 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,227 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,228 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,228 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,228 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,229 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,299 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/hadoop-8614801875605251645.jar 2023-02-07 19:03:45,300 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,300 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,300 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,301 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,301 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,301 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,302 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 19:03:45,302 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 19:03:45,302 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 19:03:45,303 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 19:03:45,303 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 19:03:45,303 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 19:03:45,304 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 19:03:45,304 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 19:03:45,304 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 19:03:45,305 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 19:03:45,305 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 19:03:45,306 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:45,306 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:45,306 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 19:03:45,306 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 19:03:45,376 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/hadoop-2586586697343712179.jar 2023-02-07 19:03:45,377 DEBUG [Listener at localhost/35645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 19:03:45,382 WARN [Listener at localhost/35645] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 19:03:45,414 INFO [Listener at localhost/35645] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 19:03:45,496 WARN [Listener at localhost/35645] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/mapreduce.cluster.local.dir/1675796625460/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 19:03:45,497 WARN [Listener at localhost/35645] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/mapreduce.cluster.local.dir/1675796625460/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 19:03:45,527 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 19:03:45,527 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 19:03:45,528 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 19:03:45,529 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:45,530 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1 2023-02-07 19:03:45,531 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc117f90ab205091051ef7bca51e1532 columnFamilyName f1 2023-02-07 19:03:45,535 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(539): loaded hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/testWithMapReduce=fc117f90ab205091051ef7bca51e1532-07ae1e4bcfb744a5b109379bfcce7414 2023-02-07 19:03:45,535 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(310): Store=fc117f90ab205091051ef7bca51e1532/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:45,535 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:45,536 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2 2023-02-07 19:03:45,536 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc117f90ab205091051ef7bca51e1532 columnFamilyName f2 2023-02-07 19:03:45,540 DEBUG [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(539): loaded hdfs://localhost:43805/user/jenkins/test-data/9dfe1c80-c273-7f7e-d991-4d7f7d314d95/testWithMapReduceSingleRegion/f74d4b34-b0c6-45f6-af60-f5dcf268da4c/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/testWithMapReduce=fc117f90ab205091051ef7bca51e1532-139982e079494274987679a0c596e07c 2023-02-07 19:03:45,540 INFO [StoreOpener-fc117f90ab205091051ef7bca51e1532-1] regionserver.HStore(310): Store=fc117f90ab205091051ef7bca51e1532/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 19:03:45,541 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 19:03:45,541 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fc117f90ab205091051ef7bca51e1532; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73093555, jitterRate=0.08917884528636932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 19:03:45,541 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fc117f90ab205091051ef7bca51e1532: Writing region info on filesystem at 1675796625528Initializing all the Stores at 1675796625529 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796625529Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675796625529Region opened successfully at 1675796625541 (+12 ms) 2023-02-07 19:03:45,657 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fc117f90ab205091051ef7bca51e1532, disabling compactions & flushes 2023-02-07 19:03:45,657 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,657 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,657 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. after waiting 0 ms 2023-02-07 19:03:45,657 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,658 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:45,658 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fc117f90ab205091051ef7bca51e1532: Waiting for close lock at 1675796625657Disabling compacts and flushes for region at 1675796625657Disabling writes for close at 1675796625657Writing region close event to WAL at 1675796625658 (+1 ms)Closed at 1675796625658 2023-02-07 19:03:46,530 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,530 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMapReduceSingleRegion" 2023-02-07 19:03:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-07 19:03:46,534 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,534 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,534 INFO [Listener at localhost/35645] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 19:03:46,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-07 19:03:46,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,537 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,537 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796626537"}]},"ts":"1675796626537"} 2023-02-07 19:03:46,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:46,539 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-07 19:03:46,540 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-07 19:03:46,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, UNASSIGN}] 2023-02-07 19:03:46,541 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, UNASSIGN 2023-02-07 19:03:46,542 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fc117f90ab205091051ef7bca51e1532, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:46,542 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675796626542"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675796626542"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675796626542"}]},"ts":"1675796626542"} 2023-02-07 19:03:46,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure fc117f90ab205091051ef7bca51e1532, server=jenkins-hbase6.apache.org,45543,1675796622708}] 2023-02-07 19:03:46,638 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,638 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:46,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:46,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing fc117f90ab205091051ef7bca51e1532, disabling compactions & flushes 2023-02-07 19:03:46,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:46,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:46,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. after waiting 0 ms 2023-02-07 19:03:46,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:46,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 19:03:46,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532. 2023-02-07 19:03:46,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for fc117f90ab205091051ef7bca51e1532: Waiting for close lock at 1675796626695Running coprocessor pre-close hooks at 1675796626695Disabling compacts and flushes for region at 1675796626695Disabling writes for close at 1675796626695Writing region close event to WAL at 1675796626696 (+1 ms)Running coprocessor post-close hooks at 1675796626699 (+3 ms)Closed at 1675796626700 (+1 ms) 2023-02-07 19:03:46,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:46,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fc117f90ab205091051ef7bca51e1532, regionState=CLOSED 2023-02-07 19:03:46,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675796626702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675796626702"}]},"ts":"1675796626702"} 2023-02-07 19:03:46,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 19:03:46,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure fc117f90ab205091051ef7bca51e1532, server=jenkins-hbase6.apache.org,45543,1675796622708 in 160 msec 2023-02-07 19:03:46,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 19:03:46,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc117f90ab205091051ef7bca51e1532, UNASSIGN in 163 msec 2023-02-07 19:03:46,706 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675796626706"}]},"ts":"1675796626706"} 2023-02-07 19:03:46,707 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-07 19:03:46,708 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-07 19:03:46,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 174 msec 2023-02-07 19:03:46,839 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,839 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 19:03:46,841 INFO [Listener at localhost/35645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-07 19:03:46,841 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,841 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMapReduce 2023-02-07 19:03:46,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,844 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,844 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,844 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,844 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:46,847 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:46,849 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1, FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2, FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/recovered.edits] 2023-02-07 19:03:46,852 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/07ae1e4bcfb744a5b109379bfcce7414 to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/archive/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/07ae1e4bcfb744a5b109379bfcce7414 2023-02-07 19:03:46,853 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/4e27a907a05d4352a702f872e25bb982 to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/archive/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f1/4e27a907a05d4352a702f872e25bb982 2023-02-07 19:03:46,855 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/139982e079494274987679a0c596e07c to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/archive/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/139982e079494274987679a0c596e07c 2023-02-07 19:03:46,856 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/60969174974c4fe3ab9e1c388051e0bb to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/archive/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/f2/60969174974c4fe3ab9e1c388051e0bb 2023-02-07 19:03:46,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/recovered.edits/12.seqid to hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/archive/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532/recovered.edits/12.seqid 2023-02-07 19:03:46,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/.tmp/data/default/testWithMapReduce/fc117f90ab205091051ef7bca51e1532 2023-02-07 19:03:46,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 19:03:46,860 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,862 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-07 19:03:46,863 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-07 19:03:46,864 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,864 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-07 19:03:46,864 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675796626864"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:46,865 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 19:03:46,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fc117f90ab205091051ef7bca51e1532, NAME => 'testWithMapReduce,,1675796623768.fc117f90ab205091051ef7bca51e1532.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 19:03:46,865 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-07 19:03:46,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675796626865"}]},"ts":"9223372036854775807"} 2023-02-07 19:03:46,866 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-07 19:03:46,868 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 19:03:46,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-07 19:03:46,945 INFO [Listener at localhost/35645] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 19:03:46,945 INFO [Listener at localhost/35645] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 19:03:46,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45359] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 19:03:46,947 INFO [Listener at localhost/35645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-07 19:03:46,947 INFO [Listener at localhost/35645] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 19:03:46,947 INFO [Listener at localhost/35645] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 19:03:46,947 DEBUG [Listener at localhost/35645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16dff0d5 to 127.0.0.1:61731 2023-02-07 19:03:46,947 DEBUG [Listener at localhost/35645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:46,947 DEBUG [Listener at localhost/35645] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 19:03:46,947 DEBUG [Listener at localhost/35645] util.JVMClusterUtil(257): Found active master hash=428066993, stopped=false 2023-02-07 19:03:46,948 INFO [Listener at localhost/35645] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:46,950 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:46,950 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:46,950 INFO [Listener at localhost/35645] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 19:03:46,950 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 19:03:46,950 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:46,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:46,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:46,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 19:03:46,954 DEBUG [Listener at localhost/35645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x246ad453 to 127.0.0.1:61731 2023-02-07 19:03:46,954 DEBUG [Listener at localhost/35645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:46,954 INFO [Listener at localhost/35645] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,45543,1675796622708' ***** 2023-02-07 19:03:46,955 INFO [Listener at localhost/35645] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:46,955 INFO [Listener at localhost/35645] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44643,1675796622732' ***** 2023-02-07 19:03:46,955 INFO [Listener at localhost/35645] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 19:03:46,955 INFO [RS:0;jenkins-hbase6:45543] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:46,955 INFO [RS:1;jenkins-hbase6:44643] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 19:03:46,955 INFO [RS:0;jenkins-hbase6:45543] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:46,955 INFO [RS:1;jenkins-hbase6:44643] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 19:03:46,955 INFO [RS:0;jenkins-hbase6:45543] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:46,955 INFO [RS:1;jenkins-hbase6:44643] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 19:03:46,955 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(3304): Received CLOSE for 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:46,955 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:46,955 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:46,955 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 19:03:46,956 DEBUG [RS:0;jenkins-hbase6:45543] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34501ccd to 127.0.0.1:61731 2023-02-07 19:03:46,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1ebce3de244d95bb80bebb0122d4acc7, disabling compactions & flushes 2023-02-07 19:03:46,955 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:46,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:46,957 DEBUG [RS:0;jenkins-hbase6:45543] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:46,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:46,957 INFO [RS:0;jenkins-hbase6:45543] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:46,957 INFO [RS:0;jenkins-hbase6:45543] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:46,957 INFO [RS:0;jenkins-hbase6:45543] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:46,957 DEBUG [RS:1;jenkins-hbase6:44643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4595abc5 to 127.0.0.1:61731 2023-02-07 19:03:46,958 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 19:03:46,958 DEBUG [RS:1;jenkins-hbase6:44643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:46,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. after waiting 0 ms 2023-02-07 19:03:46,958 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44643,1675796622732; all regions closed. 2023-02-07 19:03:46,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:46,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1ebce3de244d95bb80bebb0122d4acc7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 19:03:46,958 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-07 19:03:46,958 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 1ebce3de244d95bb80bebb0122d4acc7=hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7.} 2023-02-07 19:03:46,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 19:03:46,958 DEBUG [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1505): Waiting on 1588230740, 1ebce3de244d95bb80bebb0122d4acc7 2023-02-07 19:03:46,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 19:03:46,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 19:03:46,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 19:03:46,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 19:03:46,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-07 19:03:46,962 DEBUG [RS:1;jenkins-hbase6:44643] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/oldWALs 2023-02-07 19:03:46,962 INFO [RS:1;jenkins-hbase6:44643] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44643%2C1675796622732:(num 1675796624029) 2023-02-07 19:03:46,962 DEBUG [RS:1;jenkins-hbase6:44643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:46,962 INFO [RS:1;jenkins-hbase6:44643] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:46,962 INFO [RS:1;jenkins-hbase6:44643] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:46,962 INFO [RS:1;jenkins-hbase6:44643] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 19:03:46,962 INFO [RS:1;jenkins-hbase6:44643] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 19:03:46,962 INFO [RS:1;jenkins-hbase6:44643] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 19:03:46,963 INFO [RS:1;jenkins-hbase6:44643] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44643 2023-02-07 19:03:46,964 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:46,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/.tmp/info/718bc19b26fc4e3ba54173b8f27e544a 2023-02-07 19:03:46,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/.tmp/info/57d71e2d83d640bca522bbef1dd351a0 2023-02-07 19:03:46,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/.tmp/info/718bc19b26fc4e3ba54173b8f27e544a as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/info/718bc19b26fc4e3ba54173b8f27e544a 2023-02-07 19:03:46,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57d71e2d83d640bca522bbef1dd351a0 2023-02-07 19:03:46,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/info/718bc19b26fc4e3ba54173b8f27e544a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 19:03:46,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1ebce3de244d95bb80bebb0122d4acc7 in 22ms, sequenceid=6, compaction requested=false 2023-02-07 19:03:46,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/.tmp/rep_barrier/ecf62c58e0054c0d927ade0a75615253 2023-02-07 19:03:46,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/namespace/1ebce3de244d95bb80bebb0122d4acc7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 19:03:46,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:46,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1ebce3de244d95bb80bebb0122d4acc7: Waiting for close lock at 1675796626956Running coprocessor pre-close hooks at 1675796626956Disabling compacts and flushes for region at 1675796626956Disabling writes for close at 1675796626958 (+2 ms)Obtaining lock to block concurrent updates at 1675796626958Preparing flush snapshotting stores in 1ebce3de244d95bb80bebb0122d4acc7 at 1675796626958Finished memstore snapshotting hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675796626958Flushing stores of hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. at 1675796626959 (+1 ms)Flushing 1ebce3de244d95bb80bebb0122d4acc7/info: creating writer at 1675796626959Flushing 1ebce3de244d95bb80bebb0122d4acc7/info: appending metadata at 1675796626962 (+3 ms)Flushing 1ebce3de244d95bb80bebb0122d4acc7/info: closing flushed file at 1675796626962Flushing 1ebce3de244d95bb80bebb0122d4acc7/info: reopening flushed file at 1675796626976 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1ebce3de244d95bb80bebb0122d4acc7 in 22ms, sequenceid=6, compaction requested=false at 1675796626980 (+4 ms)Writing region close event to WAL at 1675796626981 (+1 ms)Running coprocessor post-close hooks at 1675796626984 (+3 ms)Closed at 1675796626984 2023-02-07 19:03:46,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675796623288.1ebce3de244d95bb80bebb0122d4acc7. 2023-02-07 19:03:46,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecf62c58e0054c0d927ade0a75615253 2023-02-07 19:03:47,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/.tmp/table/17568752b47b48058c6c2f9fcb700306 2023-02-07 19:03:47,000 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 19:03:47,000 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 19:03:47,001 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:47,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17568752b47b48058c6c2f9fcb700306 2023-02-07 19:03:47,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/.tmp/info/57d71e2d83d640bca522bbef1dd351a0 as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/info/57d71e2d83d640bca522bbef1dd351a0 2023-02-07 19:03:47,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57d71e2d83d640bca522bbef1dd351a0 2023-02-07 19:03:47,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/info/57d71e2d83d640bca522bbef1dd351a0, entries=12, sequenceid=21, filesize=6.2 K 2023-02-07 19:03:47,008 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:47,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/.tmp/rep_barrier/ecf62c58e0054c0d927ade0a75615253 as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/rep_barrier/ecf62c58e0054c0d927ade0a75615253 2023-02-07 19:03:47,013 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecf62c58e0054c0d927ade0a75615253 2023-02-07 19:03:47,013 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/rep_barrier/ecf62c58e0054c0d927ade0a75615253, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 19:03:47,013 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/.tmp/table/17568752b47b48058c6c2f9fcb700306 as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/table/17568752b47b48058c6c2f9fcb700306 2023-02-07 19:03:47,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17568752b47b48058c6c2f9fcb700306 2023-02-07 19:03:47,017 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/table/17568752b47b48058c6c2f9fcb700306, entries=4, sequenceid=21, filesize=5.0 K 2023-02-07 19:03:47,017 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false 2023-02-07 19:03:47,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 19:03:47,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 19:03:47,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:47,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675796626958Running coprocessor pre-close hooks at 1675796626958Disabling compacts and flushes for region at 1675796626958Disabling writes for close at 1675796626958Obtaining lock to block concurrent updates at 1675796626958Preparing flush snapshotting stores in 1588230740 at 1675796626958Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675796626958Flushing stores of hbase:meta,,1.1588230740 at 1675796626959 (+1 ms)Flushing 1588230740/info: creating writer at 1675796626959Flushing 1588230740/info: appending metadata at 1675796626962 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675796626962Flushing 1588230740/rep_barrier: creating writer at 1675796626976 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675796626978 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675796626978Flushing 1588230740/table: creating writer at 1675796626988 (+10 ms)Flushing 1588230740/table: appending metadata at 1675796626990 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675796626990Flushing 1588230740/info: reopening flushed file at 1675796627005 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675796627010 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675796627014 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false at 1675796627017 (+3 ms)Writing region close event to WAL at 1675796627018 (+1 ms)Running coprocessor post-close hooks at 1675796627021 (+3 ms)Closed at 1675796627023 (+2 ms) 2023-02-07 19:03:47,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 19:03:47,060 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:47,060 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44643,1675796622732 2023-02-07 19:03:47,060 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c76df54 rejected from java.util.concurrent.ThreadPoolExecutor@68495602[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,060 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:47,060 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:47,060 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@467a2719 rejected from java.util.concurrent.ThreadPoolExecutor@68495602[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,060 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:47,061 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44643,1675796622732] 2023-02-07 19:03:47,061 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44643,1675796622732; numProcessing=1 2023-02-07 19:03:47,063 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44643,1675796622732 already deleted, retry=false 2023-02-07 19:03:47,063 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44643,1675796622732 expired; onlineServers=1 2023-02-07 19:03:47,158 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,45543,1675796622708; all regions closed. 2023-02-07 19:03:47,163 DEBUG [RS:0;jenkins-hbase6:45543] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/oldWALs 2023-02-07 19:03:47,163 INFO [RS:0;jenkins-hbase6:45543] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C45543%2C1675796622708.meta:.meta(num 1675796623235) 2023-02-07 19:03:47,166 DEBUG [RS:0;jenkins-hbase6:45543] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/oldWALs 2023-02-07 19:03:47,166 INFO [RS:0;jenkins-hbase6:45543] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C45543%2C1675796622708:(num 1675796623642) 2023-02-07 19:03:47,166 DEBUG [RS:0;jenkins-hbase6:45543] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:47,166 INFO [RS:0;jenkins-hbase6:45543] regionserver.LeaseManager(133): Closed leases 2023-02-07 19:03:47,166 INFO [RS:0;jenkins-hbase6:45543] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 19:03:47,167 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:47,169 INFO [RS:0;jenkins-hbase6:45543] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:45543 2023-02-07 19:03:47,171 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,45543,1675796622708 2023-02-07 19:03:47,171 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 19:03:47,171 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@562d2e44 rejected from java.util.concurrent.ThreadPoolExecutor@5212b059[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,172 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,45543,1675796622708] 2023-02-07 19:03:47,172 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,45543,1675796622708; numProcessing=2 2023-02-07 19:03:47,173 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,45543,1675796622708 already deleted, retry=false 2023-02-07 19:03:47,173 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,45543,1675796622708 expired; onlineServers=0 2023-02-07 19:03:47,173 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,45359,1675796622650' ***** 2023-02-07 19:03:47,173 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 19:03:47,174 DEBUG [M:0;jenkins-hbase6:45359] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dbc4f59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-07 19:03:47,174 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,45359,1675796622650 2023-02-07 19:03:47,174 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,45359,1675796622650; all regions closed. 2023-02-07 19:03:47,174 DEBUG [M:0;jenkins-hbase6:45359] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 19:03:47,174 DEBUG [M:0;jenkins-hbase6:45359] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 19:03:47,175 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 19:03:47,175 DEBUG [M:0;jenkins-hbase6:45359] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 19:03:47,175 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796622888] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1675796622888,5,FailOnTimeoutGroup] 2023-02-07 19:03:47,175 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796622888] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1675796622888,5,FailOnTimeoutGroup] 2023-02-07 19:03:47,175 INFO [M:0;jenkins-hbase6:45359] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 19:03:47,176 INFO [M:0;jenkins-hbase6:45359] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 19:03:47,176 INFO [M:0;jenkins-hbase6:45359] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-07 19:03:47,176 DEBUG [M:0;jenkins-hbase6:45359] master.HMaster(1502): Stopping service threads 2023-02-07 19:03:47,176 INFO [M:0;jenkins-hbase6:45359] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 19:03:47,177 ERROR [M:0;jenkins-hbase6:45359] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 19:03:47,177 INFO [M:0;jenkins-hbase6:45359] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 19:03:47,177 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 19:03:47,177 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 19:03:47,177 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 19:03:47,177 DEBUG [M:0;jenkins-hbase6:45359] zookeeper.ZKUtil(398): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 19:03:47,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 19:03:47,178 WARN [M:0;jenkins-hbase6:45359] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 19:03:47,178 INFO [M:0;jenkins-hbase6:45359] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 19:03:47,178 INFO [M:0;jenkins-hbase6:45359] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 19:03:47,178 DEBUG [M:0;jenkins-hbase6:45359] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 19:03:47,179 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:47,179 DEBUG [M:0;jenkins-hbase6:45359] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:47,179 DEBUG [M:0;jenkins-hbase6:45359] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 19:03:47,179 DEBUG [M:0;jenkins-hbase6:45359] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:47,179 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.70 KB heapSize=65.67 KB 2023-02-07 19:03:47,186 INFO [M:0;jenkins-hbase6:45359] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.70 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/826c4a3345204573a7b900c7d64aee7b 2023-02-07 19:03:47,191 DEBUG [M:0;jenkins-hbase6:45359] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/826c4a3345204573a7b900c7d64aee7b as hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/826c4a3345204573a7b900c7d64aee7b 2023-02-07 19:03:47,194 INFO [M:0;jenkins-hbase6:45359] regionserver.HStore(1080): Added hdfs://localhost:43805/user/jenkins/test-data/55990216-f88d-d513-a637-b68b3acbd294/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/826c4a3345204573a7b900c7d64aee7b, entries=17, sequenceid=132, filesize=8.6 K 2023-02-07 19:03:47,195 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegion(2947): Finished flush of dataSize ~54.70 KB/56017, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-07 19:03:47,196 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 19:03:47,196 DEBUG [M:0;jenkins-hbase6:45359] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675796627178Disabling compacts and flushes for region at 1675796627178Disabling writes for close at 1675796627179 (+1 ms)Obtaining lock to block concurrent updates at 1675796627179Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675796627179Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56017, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1675796627179Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675796627180 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675796627180Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675796627182 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675796627182Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675796627191 (+9 ms)Finished flush of dataSize ~54.70 KB/56017, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675796627195 (+4 ms)Writing region close event to WAL at 1675796627196 (+1 ms)Closed at 1675796627196 2023-02-07 19:03:47,199 INFO [M:0;jenkins-hbase6:45359] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 19:03:47,199 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 19:03:47,199 INFO [M:0;jenkins-hbase6:45359] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:45359 2023-02-07 19:03:47,202 DEBUG [M:0;jenkins-hbase6:45359] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,45359,1675796622650 already deleted, retry=false 2023-02-07 19:03:47,350 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:47,350 INFO [M:0;jenkins-hbase6:45359] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,45359,1675796622650; zookeeper connection closed. 2023-02-07 19:03:47,350 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1036826d rejected from java.util.concurrent.ThreadPoolExecutor@140904b3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,351 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): master:45359-0x1013e98616c0000, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:47,351 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44917ac3 rejected from java.util.concurrent.ThreadPoolExecutor@140904b3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,450 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:47,451 INFO [RS:0;jenkins-hbase6:45543] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,45543,1675796622708; zookeeper connection closed. 2023-02-07 19:03:47,451 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@192d9627 rejected from java.util.concurrent.ThreadPoolExecutor@5212b059[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,451 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:45543-0x1013e98616c0001, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:47,451 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@611a38b0 rejected from java.util.concurrent.ThreadPoolExecutor@5212b059[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,451 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b14313f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b14313f 2023-02-07 19:03:47,551 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:47,551 INFO [RS:1;jenkins-hbase6:44643] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44643,1675796622732; zookeeper connection closed. 2023-02-07 19:03:47,551 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ef7703c rejected from java.util.concurrent.ThreadPoolExecutor@68495602[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,551 DEBUG [Listener at localhost/35645-EventThread] zookeeper.ZKWatcher(600): regionserver:44643-0x1013e98616c0002, quorum=127.0.0.1:61731, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 19:03:47,551 ERROR [Listener at localhost/35645-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ab19e7a rejected from java.util.concurrent.ThreadPoolExecutor@68495602[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 19:03:47,551 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f3754c0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f3754c0 2023-02-07 19:03:47,551 INFO [Listener at localhost/35645] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 19:03:47,552 WARN [Listener at localhost/35645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:47,556 INFO [Listener at localhost/35645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:47,657 WARN [BP-642655484-172.31.2.20-1675796622016 heartbeating to localhost/127.0.0.1:43805] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:47,657 WARN [BP-642655484-172.31.2.20-1675796622016 heartbeating to localhost/127.0.0.1:43805] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-642655484-172.31.2.20-1675796622016 (Datanode Uuid 9b17bed6-ebdb-4918-93fd-f28528a120d5) service to localhost/127.0.0.1:43805 2023-02-07 19:03:47,658 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/dfs/data/data3/current/BP-642655484-172.31.2.20-1675796622016] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:47,658 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/dfs/data/data4/current/BP-642655484-172.31.2.20-1675796622016] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:47,660 WARN [Listener at localhost/35645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 19:03:47,663 INFO [Listener at localhost/35645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:47,764 WARN [BP-642655484-172.31.2.20-1675796622016 heartbeating to localhost/127.0.0.1:43805] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 19:03:47,764 WARN [BP-642655484-172.31.2.20-1675796622016 heartbeating to localhost/127.0.0.1:43805] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-642655484-172.31.2.20-1675796622016 (Datanode Uuid 7f34976f-b8c8-4112-b9ba-115ac4356ef7) service to localhost/127.0.0.1:43805 2023-02-07 19:03:47,764 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/dfs/data/data1/current/BP-642655484-172.31.2.20-1675796622016] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:47,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6b974f12-3580-3099-8baf-85c3ecdc44d4/cluster_a7f421d7-669e-cd08-a94f-5e34c6b4c0d3/dfs/data/data2/current/BP-642655484-172.31.2.20-1675796622016] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 19:03:47,774 INFO [Listener at localhost/35645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 19:03:47,887 INFO [Listener at localhost/35645] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 19:03:47,903 INFO [Listener at localhost/35645] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 19:03:47,915 INFO [Listener at localhost/35645] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 273) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43805 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35645 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:43805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:43805 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:43805 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:43805 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,45359,1675796622650)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:43805 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (507396532) connection to localhost/127.0.0.1:43805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=597 (was 570) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 329), ProcessCount=169 (was 169), AvailableMemoryMB=4657 (was 4696)